Time Series - Revision history

Wordpad: BloomWiki: Time Series

2026-04-25T02:00:37Z

BloomWiki: Time Series

← Older revision		Revision as of 02:00, 25 April 2026
Line 1:		Line 1:
			<div style="background-color: #4B0082; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
	{{BloomIntro}}		{{BloomIntro}}
	Time Series Analysis is a statistical technique that deals with time series data, or trend analysis. Time series data is a sequence of data points indexed in time order (e.g., stock prices, weather data, or population growth). Unlike standard statistics, which assumes data points are independent, time series analysis recognizes that "what happened yesterday" often affects "what happens today." By identifying patterns such as trends, seasonality, and cycles, time series analysis allows us to forecast the future, detect anomalies, and understand the dynamic forces that drive a system over time.		Time Series Analysis is a statistical technique that deals with time series data, or trend analysis. Time series data is a sequence of data points indexed in time order (e.g., stock prices, weather data, or population growth). Unlike standard statistics, which assumes data points are independent, time series analysis recognizes that "what happened yesterday" often affects "what happens today." By identifying patterns such as trends, seasonality, and cycles, time series analysis allows us to forecast the future, detect anomalies, and understand the dynamic forces that drive a system over time.
			</div>

	== Remembering ==		__TOC__

			<div style="background-color: #000080; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Remembering</span> ==
	* '''Time Series''' — A series of data points indexed (or listed or graphed) in time order.		* '''Time Series''' — A series of data points indexed (or listed or graphed) in time order.
	* '''Trend''' — The long-term increase or decrease in the data (e.g., global warming).		* '''Trend''' — The long-term increase or decrease in the data (e.g., global warming).
Line 17:		Line 22:
	* '''Exponential Smoothing''' — A technique that gives more "weight" to recent data points when forecasting.		* '''Exponential Smoothing''' — A technique that gives more "weight" to recent data points when forecasting.
	* '''Seasonally Adjusted''' — Data that has had the seasonal component removed to reveal the true trend.		* '''Seasonally Adjusted''' — Data that has had the seasonal component removed to reveal the true trend.
			</div>

	== Understanding ==		<div style="background-color: #006400; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Understanding</span> ==
	Time series analysis is about "Decomposing" a complex signal into its parts.		Time series analysis is about "Decomposing" a complex signal into its parts.

Line 28:		Line 35:

	'''Autoregression (AR)''': This is the idea that the current value is a linear function of previous values. If it rained yesterday, it is more likely to rain today. The strength of this relationship is measured by '''Autocorrelation'''.		'''Autoregression (AR)''': This is the idea that the current value is a linear function of previous values. If it rained yesterday, it is more likely to rain today. The strength of this relationship is measured by '''Autocorrelation'''.
			</div>

	== Applying ==		<div style="background-color: #8B0000; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Applying</span> ==
	'''Calculating a Simple Moving Average (SMA):'''		'''Calculating a Simple Moving Average (SMA):'''
	<syntaxhighlight lang="python">		<syntaxhighlight lang="python">
Line 57:		Line 66:
	: '''IoT / Sensors''' → Detecting an "Anomaly" (e.g., a machine vibrating weirdly) in a constant stream of data.		: '''IoT / Sensors''' → Detecting an "Anomaly" (e.g., a machine vibrating weirdly) in a constant stream of data.
	: '''Inventory Management''' → Predicting how many turkeys to stock before Thanksgiving based on the last 5 years of data.		: '''Inventory Management''' → Predicting how many turkeys to stock before Thanksgiving based on the last 5 years of data.
			</div>

	== Analyzing ==		<div style="background-color: #8B4500; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Analyzing</span> ==
	{\| class="wikitable"		{\| class="wikitable"
	\|+ Additive vs. Multiplicative Seasonality		\|+ Additive vs. Multiplicative Seasonality
Line 69:		Line 80:

	'''The Random Walk''': Some time series (like the stock market in the short term) are "Random Walks." This means the best prediction for tomorrow is simply "whatever it is today" plus some random noise. In a true random walk, technical analysis (looking at charts) is impossible—a hard lesson for many traders.		'''The Random Walk''': Some time series (like the stock market in the short term) are "Random Walks." This means the best prediction for tomorrow is simply "whatever it is today" plus some random noise. In a true random walk, technical analysis (looking at charts) is impossible—a hard lesson for many traders.
			</div>

	== Evaluating ==		<div style="background-color: #483D8B; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Evaluating</span> ==
	Evaluating a forecast:		Evaluating a forecast:
	# '''RMSE (Root Mean Square Error)''': How far off were our predictions on average?		# '''RMSE (Root Mean Square Error)''': How far off were our predictions on average?
Line 76:		Line 89:
	# '''Lag''': Does the model "lag" behind reality (only predicting a crash ''after'' it starts)?		# '''Lag''': Does the model "lag" behind reality (only predicting a crash ''after'' it starts)?
	# '''White Noise''': Are the "residuals" (the errors) random? If the errors have a pattern, it means our model is missing something.		# '''White Noise''': Are the "residuals" (the errors) random? If the errors have a pattern, it means our model is missing something.
			</div>

	== Creating ==		<div style="background-color: #2F4F4F; color: #FFFFFF; padding: 20px; border-radius: 8px; margin-bottom: 15px;">
			== <span style="color: #FFFFFF;">Creating</span> ==
	Future Frontiers:		Future Frontiers:
	# '''LSTM (Long Short-Term Memory)''': Using deep learning (RNNs) to capture extremely long-term dependencies in data (e.g., weather patterns over decades).		# '''LSTM (Long Short-Term Memory)''': Using deep learning (RNNs) to capture extremely long-term dependencies in data (e.g., weather patterns over decades).
Line 87:		Line 102:
	[[Category:Data Science]]		[[Category:Data Science]]
	[[Category:Finance]]		[[Category:Finance]]
			</div>

Wordpad: BloomWiki: Time Series

2026-04-23T14:37:37Z

BloomWiki: Time Series

Show changes

Wordpad: BloomWiki: Time Series

2026-04-23T14:35:16Z

BloomWiki: Time Series

Show changes

Wordpad: BloomWiki: Time Series

2026-04-23T14:28:25Z

BloomWiki: Time Series

Show changes

Wordpad: BloomWiki: Time Series

2026-04-23T14:26:05Z

BloomWiki: Time Series

Show changes

Wordpad: BloomWiki: Time Series

2026-04-23T14:22:28Z

BloomWiki: Time Series

Show changes

Wordpad: BloomWiki: Time Series

2026-04-23T14:19:49Z

BloomWiki: Time Series

New page

{{BloomIntro}}
AI for time series and forecasting applies machine learning and deep learning techniques to sequential, time-indexed data to predict future values, detect anomalies, and extract patterns. Time series data is ubiquitous: stock prices, electricity demand, web traffic, sensor readings, weather measurements, and patient vital signs all evolve over time. Traditional forecasting relied on statistical models like ARIMA; modern AI-driven approaches — including LSTMs, Temporal Fusion Transformers, and foundation models for time series — now achieve state-of-the-art performance across domains.

== Remembering ==
* '''Time series''' — A sequence of data points indexed in time order, typically at regular intervals.
* '''Forecasting''' — Predicting future values of a time series based on its historical patterns.
* '''Univariate time series''' — A single variable measured over time (e.g., daily sales).
* '''Multivariate time series''' — Multiple variables measured simultaneously over time (e.g., temperature, humidity, and pressure together).
* '''Trend''' — The long-term direction of a time series (upward, downward, or flat).
* '''Seasonality''' — Regular, periodic patterns that repeat at known intervals (daily, weekly, yearly).
* '''Residuals''' — The component remaining after removing trend and seasonality; ideally random noise.
* '''Stationarity''' — A time series is stationary if its statistical properties (mean, variance) do not change over time. Many models require stationarity.
* '''Autocorrelation''' — The correlation of a time series with its own past values (lags).
* '''Lag''' — A prior time step. Lag-1 is yesterday's value; lag-7 is last week's value.
* '''ARIMA''' — AutoRegressive Integrated Moving Average; a classical statistical model for univariate forecasting.
* '''LSTM (Long Short-Term Memory)''' — A type of RNN with gating mechanisms that captures long-range dependencies in sequences.
* '''Temporal Fusion Transformer (TFT)''' — A transformer-based model for multi-horizon time series forecasting, incorporating attention across time.
* '''Anomaly detection''' — Identifying data points, intervals, or patterns that deviate significantly from expected behavior.
* '''Horizon''' — The number of future time steps to forecast (1-step-ahead vs. multi-step/multi-horizon).
* '''Rolling forecast''' — Re-fitting or updating the model as new data arrives, maintaining accuracy over time.

== Understanding ==
Time series forecasting is inherently a sequential problem: the order of observations matters, and the past contains information about the future. This distinguishes it from tabular classification, where rows are exchangeable.

'''The decomposition framework''' is key to understanding time series:
<syntaxhighlight lang="text">
Observed = Trend × Seasonal × Residual (multiplicative)
= Trend + Seasonal + Residual (additive)
</syntaxhighlight>
Decomposing a series into these components enables targeted modeling: model the trend with regression, the seasonality with Fourier features or indicator variables, and the residual with a neural network or ARIMA.

'''Why deep learning?''' Classical models like ARIMA excel at capturing simple autocorrelation but struggle with:
* Non-linear relationships between variables
* Multiple interacting series (multivariate)
* Complex, multi-scale seasonality
* Incorporating exogenous variables (weather, holidays, promotions)

LSTMs can capture non-linear temporal dependencies and handle arbitrary-length sequences. Transformers add the ability to attend to any past time step directly, avoiding the vanishing gradient problem over long sequences. Foundation models for time series (TimeGPT, MOIRAI, Chronos) pre-trained on billions of time points can zero-shot forecast on new series.

'''Evaluation discipline''': A critical mistake in time series is using random train/test splits. This causes data leakage — future data leaks into the training set. Always use chronological splits: train on the first 70–80%, validate on the next 10–15%, test on the most recent 10–15%.

== Applying ==
'''Multi-horizon forecasting with Temporal Fusion Transformer (PyTorch Forecasting):'''

<syntaxhighlight lang="python">
import pandas as pd
from pytorch_forecasting import TimeSeriesDataSet, TemporalFusionTransformer
from pytorch_forecasting.metrics import QuantileLoss
import lightning.pytorch as pl

# Load data: each row = one time step for one series
df = pd.read_csv("sales_data.csv")
df["time_idx"] = (df["date"] - df["date"].min()).dt.days # integer time index

max_encoder_length = 60 # Use 60 past days as context
max_prediction_length = 14 # Forecast 14 days ahead

# Training dataset
training = TimeSeriesDataSet(
df[lambda x: x.time_idx <= x.time_idx.max() - max_prediction_length],
time_idx="time_idx",
target="sales",
group_ids=["store_id", "product_id"], # Multiple series
min_encoder_length=30,
max_encoder_length=max_encoder_length,
max_prediction_length=max_prediction_length,
static_categoricals=["store_id", "product_id"],
time_varying_known_reals=["time_idx", "price", "day_of_week", "is_holiday"],
time_varying_unknown_reals=["sales"], # Only target is "unknown" in future
target_normalizer="auto",
)

validation = TimeSeriesDataSet.from_dataset(training, df, predict=True, stop_randomization=True)
train_dl = training.to_dataloader(train=True, batch_size=64)
val_dl = validation.to_dataloader(train=False, batch_size=64)

# TFT model
tft = TemporalFusionTransformer.from_dataset(
training,
learning_rate=0.03,
hidden_size=64,
attention_head_size=4,
dropout=0.1,
hidden_continuous_size=32,
output_size=7, # 7 quantile predictions (p10 to p90)
loss=QuantileLoss(),
log_interval=10,
)

trainer = pl.Trainer(max_epochs=30, accelerator="gpu", gradient_clip_val=0.1)
trainer.fit(tft, train_dl, val_dl)
</syntaxhighlight>

; Model selection guide by forecasting scenario
: '''Simple univariate, clean seasonality''' → SARIMA, Prophet (Meta), ETS
: '''Univariate with complex patterns''' → N-BEATS, N-HiTS, PatchTST
: '''Multivariate with known future covariates''' → Temporal Fusion Transformer, DeepAR
: '''Very short series or irregular intervals''' → Gaussian Processes, ARIMA
: '''Many series, zero-shot''' → TimeGPT, Chronos, MOIRAI (foundation models)
: '''Anomaly detection''' → Isolation Forest (tabular features), LSTMAD, Anomaly Transformer

== Analyzing ==
{| class="wikitable"
|+ Time Series Model Comparison
! Model !! Type !! Strengths !! Weaknesses
|-
| ARIMA/SARIMA || Statistical || Interpretable, fast, works on small data || Assumes linearity, one series at a time
|-
| Prophet || Statistical || Handles holidays, trend changepoints || Limited to single series; no covariates
|-
| DeepAR || Deep Learning (LSTM) || Probabilistic, many series || Needs lots of data, slow training
|-
| TFT || Transformer || Multi-horizon, covariate-rich, interpretable || Complex, high data requirement
|-
| N-BEATS || Deep Learning (MLP) || Fast, competitive, no feature engineering || Limited covariate support
|-
| Chronos (foundation) || LLM-style || Zero-shot, no training needed || No covariate support yet; large model
|}

'''Failure modes:'''
* '''Chronological leakage''' — Random train/test splits allow future data to inform past predictions, producing falsely optimistic results. Always split chronologically.
* '''Ignoring non-stationarity''' — Many models assume stationarity. Differencing (ARIMA) or normalization per-series is required.
* '''Ignoring distributional shift''' — Retail models trained pre-COVID performed terribly during COVID. Extreme events cause structural breaks that no model trained on historical data anticipates.
* '''Point forecast overconfidence''' — Reporting only mean forecasts without uncertainty intervals. Downstream planning needs to understand the range of outcomes, not just the median.
* '''Evaluation on last segment only''' — Evaluating only on the final test period may not represent the model's general quality. Use rolling window backtesting across multiple historical windows.

== Evaluating ==
Expert time series evaluation uses multiple metrics and rigorous experimental design:

'''Regression metrics''': MAE (Mean Absolute Error), RMSE, MAPE (Mean Absolute Percentage Error), sMAPE. MAPE is undefined when actual=0 and is skewed by near-zero values; sMAPE or MAE are more robust.

'''Probabilistic metrics''': For probabilistic forecasts (quantile or interval), use CRPS (Continuous Ranked Probability Score) or Winkler score. These reward well-calibrated uncertainty.

'''Rolling window backtesting''': Instead of one train/test split, slide a window across history — train on windows [0:T], [0:T+1], … and evaluate on each subsequent step. This tests the model across many historical regimes and avoids cherry-picking a favorable test period.

'''Naive benchmarks''': Always compare to: naive (last value), seasonal naive (same period last cycle), and exponential smoothing. If a complex deep learning model cannot beat seasonal naive, it's not adding value.

Expert practitioners report backtesting results as distributions (mean ± std across windows) rather than a single number, and explicitly test for robustness during unusual periods (holidays, pandemics, market crashes).

== Creating ==
Designing a production time series forecasting system:

'''1. Data architecture'''
<syntaxhighlight lang="text">
Raw time series sources (databases, IoT, APIs)
↓
[Time-indexed storage: InfluxDB, TimescaleDB, or Parquet partitioned by date]
↓
[Feature engineering pipeline:]
│ ├── Temporal features: hour, day of week, month, quarter
│ ├── Lag features: lag-1, lag-7, lag-28, rolling mean/std
│ ├── Fourier features for seasonality
│ └── External covariates: weather, holidays, promotions
↓
[Stationarity tests + differencing if needed]
↓
[Train/val/test split: chronological]
</syntaxhighlight>

'''2. Model training and selection'''
<syntaxhighlight lang="text">
Train multiple models (baseline naive, SARIMA, TFT, foundation model)
↓
Evaluate each with rolling window backtesting
↓
Select winner by held-out test MAPE and CRPS
↓
Train ensemble: weighted average of top-3 models (often beats any single model)
↓
Register in model registry with evaluation metrics
</syntaxhighlight>

'''3. Production serving and retraining'''
* Serve forecasts via API with caching (same-day forecast is rarely regenerated)
* Nightly retrain on latest data window (rolling retrain strategy)
* Monitor forecast accuracy vs. actuals in real-time; alert on anomalies
* Detect distribution shift: plot forecast distribution vs. actuals weekly
* Trigger manual review when MAE exceeds historical 95th percentile

[[Category:Artificial Intelligence]]
[[Category:Machine Learning]]
[[Category:Time Series]]