Recalculating in big data

preprint OA: closed CC-BY-4.0
📄 Open PDF View at publisher

Abstract

The available memory on a desktop or laptop computer can easily be exceeded by large datasets when performing analytics or training machine learning algorithms. In this paper we propose simple methods to recalculate and update the value of descriptive statistics (averages, variance, coefficients of skewness and kurtosis) after rescaling, adding or excluding some data. The coefficient of determination from regression analysis is also recalculated after deleting each sample observation. The objective is to avoid including all the observations (especially in big datasets) when those statistics are recalculated. For this, only its previous value updated by the changed observations is needed, saving time in the respective calculation.

My notes (saved in your browser only)

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. The paper's references may be in our DB but unresolved to ``paper_id`` (resolution happens at ingest when the cited DOI matches a row we already have). Run the cross-source citation reconcile pass to retry.

Source provenance

europepmc
last seen: 2026-05-19T01:45:01.086888+00:00
unpaywall
last seen: 2026-05-30T02:00:01.510937+00:00
License: CC-BY-4.0