ThermoPINN is a research platform designed to empirically evaluate the reliability, safety, and failure modes of Physics-Informed Neural Networks (PINNs) in safety-critical aerospace prognostics.
Initially developed using UTDTB v5 (a custom synthetic degradation dataset), the system demonstrates robust zero-shot sim-to-real transfer to NASA N-CMAPSS telemetry and real-time edge deployment feasibility.
We identify a structural limitation of soft-constrained PINNs under distribution shift:
Soft-constrained PINNs are not identifiable under partial observability, leading to physically invalid yet accurate predictors under distribution shift. High predictive accuracy does NOT guarantee physically valid representations in safety-critical systems.
Despite achieving competitive RMSE and successful sim-to-real transfer, empirical stress tests revealed that the model's latent representations remained statistically inconsistent with governing physical laws under hypothesis testing, collapsed under out-of-distribution (OOD) sensor failure due to the Manifold Projection Hypothesis (MPH), and could not support survival-based risk modeling.
Crucially, the model failed to recover domain-invariant physical constants across datasets, which serves as the strongest empirical evidence of non-physical learning. This suggests that soft-constrained PINNs do not enforce physics—they regularize toward it. This limitation is specific to soft-constrained formulations and may not apply to hard constraints or symbolic regression hybrids.
Why this matters to aerospace: In commercial aviation, this disconnect is critical. Uncalibrated overconfidence and non-physical degradation trajectories violate assumptions required for compliance with DO-178C/ARP4761 safety processes, introducing unquantified and potentially unsafe decision risk in MRO scheduling and safety-critical decision-making.
Given a multivariate time series of sensor and environmental data
-
Predict Remaining Useful Life (RUL)
$y \in \mathbb{R}^{+}$ . -
Generalize under distribution shift
$P_{train}(X, y) \neq P_{test}(X, y)$ (Sim-to-Real). -
Regularize latent states
$z$ such that they are encouraged to satisfy$f_{phys}(z, \theta) \approx 0$ via soft constraints, where$f_{phys}$ represents governing thermodynamic laws (e.g., Paris Law).
- A 55-D physics-aware meta-learning architecture for turbofan RUL prediction.
- An empirical demonstration of deterministic feature collapse in PINNs under OOD conditions.
- Systematic evidence that MSE-trained PINNs fail to recover governing physical laws across independent datasets.
- A rigorously validated sim-to-real evaluation pipeline across N-CMAPSS, C-MAPSS, and PRONOSTIA datasets.
ThermoPINN bridges the gap between pure data-driven deep learning and physics-based prognostics by combining:
- A multi-stream encoder for high-dimensional sensor and environmental signals.
- A physics gate to impose thermodynamic structure. The gate is designed to constrain latent representations to follow thermodynamic monotonicity and degradation trends, mitigating purely statistical shortcuts.
- A Model-Agnostic Meta-Learning (MAML) loop for rapid domain adaptation.
- Conformal calibration for robust uncertainty bounds.
The model is trained on synthetic degradation trajectories and evaluated under zero-shot transfer to real-world flight telemetry.
Note: Results are reported across two regimes — synthetic benchmark (UTDTB v5) and real-world sim-to-real transfer (N-CMAPSS). Statistics are reported as Mean ± Std over 5 independent random seeds.
| Capability | Result |
|---|---|
| Sim-to-Real (N-CMAPSS) | RMSE: 31.88 ± 0.3 (Zero-Shot) |
| Cross-Domain Adaptation | -26.04 cycle improvement (Classic C-MAPSS) |
| SOTA Benchmark (UTDTB) | RMSE: 40.2 ± 0.4 |
| Physics Validity | ❌ FAILED (Learned non-physical statistical proxies) |
| Uncertainty Calibration | ❌ FAILED (OOD overconfidence / Feature collapse) |
| Edge Deployment | ✅ 4.65 ms latency (RTX 3050) |
- UTDTB v5 (Proposed): A custom synthetic 55-dimensional turbofan degradation dataset incorporating sensor, environmental, and latent physics variables.
- NASA N-CMAPSS: Real-world turbofan telemetry dataset used for primary sim-to-real validation.
- NASA C-MAPSS (Classic): Benchmark dataset for cross-domain adaptation experiments.
- FEMTO / PRONOSTIA: Bearing degradation dataset used for cross-component physics validation.
The architecture was trained purely on synthetic UTDTB v5 data and subjected to rigorous external validation across multiple real-world flight envelopes. This robustness suggests the architecture captures stable statistical structure correlated with thermodynamic behavior, though not governed by explicit physical laws.
-
NASA N-CMAPSS (Primary Sim-to-Real): In an evaluation of over 26.4 million thermodynamic windows (33 flight trajectories) handling severe distribution shifts (Mean
$KL = 0.134$ , computed between normalized feature distributions of UTDTB v5 and N-CMAPSS), the zero-shot transfer achieved an average RMSE of 31.88 cycles. - NASA Classic C-MAPSS: Utilizing a Gradient Reversal Layer (GRL) for domain alignment, the model improved target domain RMSE by 26.04 cycles unsupervised.
Fig: Feature Distribution Shift Analysis: UTDTB v5 (Synthetic) vs. NASA N-CMAPSS (Real).
Fig: Zero-Shot RUL Prediction on Real N-CMAPSS Engines.
Under identical training conditions, ThermoPINN demonstrates competitive or superior performance to purely data-driven baselines.
| Model Architecture | Params | RMSE ↓ | NASA Score ↓ |
|---|---|---|---|
| ThermoPINN (Ours, Zero-Shot) | ~800.0K | 40.2 ± 0.4* | 125.4 ± 1.2 |
| TimesNet (ICLR 2023) | 40.7K | 45.1 ± 0.8 | 140,605.3 |
| DLinear (AAAI 2023) | 0.2K | 69.5 ± 1.2 | 8.85e17† |
*Note: RMSE 40.2 reflects the UTDTB v5 benchmark comparison; 31.88 reflects N-CMAPSS sim-to-real evaluation. †Note: NASA score penalizes late predictions exponentially more than early ones, reflecting safety-critical risk asymmetry.
Fig: Operational interpretation of the NASA Asymmetric Score for MRO.
Fig: SOTA Benchmark Comparison (UTDTB v5).
A total of 25+ controlled experiments and 7 major ablation categories were conducted to validate architectural robustness and isolate failure modes. All ablation experiments were conducted under controlled settings with isolated variable modification to ensure causal interpretability of observed performance changes.
Robustness & Architecture
- Architecture Ablation: Removing physics constraints degraded RMSE (45.2 vs 42.9), confirming the contribution of thermodynamic priors.

- Feature Ablation: RMSE remained stable (~124.5–124.7 in the ablation setting) across 20D–55D inputs, indicating strong reliance on core sensor signals.
- Dimensionality Stress Test: Performance remained invariant under aggressive sensor pruning (55D → 18D), demonstrating resilience to real-world sensor dropout.

Learning Dynamics & Domain Transfer
- Meta-Learning Depth: Optimal adaptation occurs at k=2 shots; beyond this, performance degrades due to catastrophic forgetting (RMSE ↑ to 287.1 at k=7).

- Domain Adaptation (DANN): Improved target-domain RMSE by 26.04 cycles without access to labeled target data.
Uncertainty Calibration
- Monte Carlo Dropout: Reduced calibration error (ECE ↓ from 0.42 → ~0.18) under standard conditions, but failed to capture Epistemic uncertainty under OOD conditions.

-
Correlation Shortcut vs. Physics: Standard training objectives do not guarantee the emergence of governing equations. We validated this by performing Non-linear Least Squares (NLS) regression on the model's latent nodes to extract learned physics constants.
Key Finding: Latent physics nodes failed to replicate Paris-Erdogan and Arrhenius constants. While the theoretical constant
$m=3.0$ , the model converged to$m \approx 1.3$ (Relative Error: 57%,$p < 0.05$ via Kolmogorov-Smirnov test), indicating the model learned non-physical statistical proxies.
- Deterministic Feature Collapse: Post-hoc Evidential Deep Learning (EDL) wrappers fail when the encoder is not explicitly constrained. Under sensor failure, Epistemic uncertainty deflated by 0.9x.
- Latent Rigidity: Point-prediction architectures destroy the probabilistic structure required for MRO scheduling (C-Index: 0.500).
These failures persisted despite achieving RMSE < 35 cycles in sim-to-real evaluation, indicating a clear disconnect between predictive performance and physical validity. These results indicate that while ThermoPINN achieves strong empirical performance, it does not yet satisfy the requirements for physically interpretable or safety-certified deployment.
Our empirical and theoretical results decouple PINN failures into three distinct categories:
-
Identifiability Failure
- Cause: Latent ambiguity under partial observability (a fundamental inverse problem).
-
Effect: Model learns wrong physics constants (e.g.,
$m=1.3$ instead of$3.0$ ).
-
Optimization Failure
-
Cause: Soft constraints (
$\lambda < \infty$ ). - Effect: Optimizer takes shortcut learning paths on the data manifold.
-
Cause: Soft constraints (
-
Representation Failure
- Cause: The Manifold Projection Hypothesis (MPH). Neural encoders behave as manifold projectors under distribution shift.
- Effect: OOD collapse leading to "fake normalcy" and overconfidence. PINN physics violation and uncertainty failure are directly driven by MPH.
All equations below are grounded in experimental results from UTDTB v5 (synthetic, 1.1M rows, 55 features) and NASA N-CMAPSS (zero-shot transfer). Every numeric constant is sourced from actual training runs.
Given a multivariate sensor time-series
Computational Graph & Gradient Flow:
- Forward pass:
- Loss decomposition:
- Backpropagation:
Gradients from physics constraints propagate only through latent physics nodes $z_{\text{phys}}$, creating partial structural regularization.
ℓ̂ = log(1 + ŷ), ℓ* = log(1 + y*), e = ℓ̂ − ℓ*
𝓛_data = E[ w(e) · H₁(e) ]
w(e) = 2.0 if e > 0 (late prediction)
w(e) = 1.0 if e ≤ 0 (early prediction)
3.1 Monotonic Degradation ✅ (100% compliant, ARP4761) Thermodynamic systems accumulate damage monotonically:
3.2 Paris–Erdogan Fatigue Crack Growth
From latent physics states
where
This exposes two distinct failure modes:
-
Scaling Failure (Implementation Issue): All physics variables are normalized during training. Physics laws are scale-sensitive; normalizing
$a$ and$\Delta K$ destroys true physical units, causing constants to become meaningless. - Identifiability Failure (Fundamental Issue): Crucially, even after correcting for scaling effects (consistent normalization), the model fails to recover domain-invariant constants across datasets. This proves the failure is structural and not merely a scaling artifact.
Enforced as residual loss:
3.3 Full Physics Loss (
4.1 ANIL Inner Loop (
Task loss includes physics in the inner loop only:
4.2 Few-Shot Adaptation Results
|
|
RMSE ↓ | NASA ↓ | ECE ↓ | Notes |
|---|---|---|---|---|
| 0 | 92.99 | 37.74 | 0.130 | |
| 5 | 31.88 | 17.99 | 0.130 | ← Pareto optimum |
| 10 | 40.10 | 24.22 | 0.057 |
🔹 Function Space & Preliminaries
Key Assumptions:
- Finite dataset:
$|\mathcal{D}| < \infty$ - Non-identifiability:
$\exists z_1 \neq z_2 \text{ s.t. } f_{\text{phys}}(z_1) = f_{\text{phys}}(z_2)$ (Multiple latent states produce identical observable outputs). - Soft constraint:
$\lambda < \infty$
🔷 The PINN Misalignment Principle
Interpretation: PINNs approximate functions well, but do not inherently stay inside the physics space. Here, $\mathcal{F}_{\text{approx}}$ denotes the class of functions representable by neural networks under finite data approximation.
🔷 Empirical Proposition (Non-Identifiability of Soft-Constrained PINNs)
Note: We provide an empirical argument supported by experimental evidence, not a formal mathematical proof. Insight: The failure of PINNs is not due to weak optimization, but due to the non-identifiability of latent physics under partial observability. The physics loss is not identifiable from observed variables, constituting a fundamental inverse problem rather than a mere training flaw.
🔷 Empirical Argument & Proof Sketch
-
Neural networks act as universal approximators.
-
Due to non-identifiability, multiple functions can produce identical outputs over the dataset:
∃ f₁, f₂ ∈ 𝓕_NN such that f₁(X) = f₂(X) ∀ X ∈ 𝓓
where f₁ ∈ 𝓕_phys and f₂ ∉ 𝓕_phys.
-
This implies the data loss is identical for both, but the physics loss is significantly different:
𝓛_data(f₁) = 𝓛_data(f₂) but 𝓛_phys(f₁) ≪ 𝓛_phys(f₂)
-
Because the physics loss acts strictly as a soft regularizer (λ < ∞), the optimizer can freely converge to the statistical shortcut f₂ without penalty on the data manifold.
-
⇒ f_θ ∉ 𝓕_phys. The failure is optimization-consistent.
5.1 Verification Mapping: Theory vs. Experiment
| Equation / Theory | Predicted Behavior | Measured Empirical Result | Implication |
|---|---|---|---|
| Paris Law ( |
NLS fit |
Learned correlation, not physics | |
| Epistemic Uncertainty | Latent space collapse | ||
| Monotonic Damage | 100% compliance | Easy topological constraint |
5.2 Domain Invariance Proof
If f_θ ∈ 𝓕_phys, then m_source = m_target must hold invariantly across domains. However, we observed m_UTDTB ≠ m_N-CMAPSS even under consistent normalization. The difference is statistically significant (p < 0.05), ruling out estimation noise. True physics is domain-invariant; learned representations are domain-dependent:
m_source ≠ m_target ⇒ f_θ ∉ 𝓕_phys
Formally: Pr( m̂ = m_true ) ≈ 0. Domain invariance violation serves as the strongest empirical evidence of non-physical learning.
6.1 Decomposed Heteroscedastic Uncertainty
6.2 Uncertainty Collapse under OOD (The Manifold Projection Hypothesis) Define the projection operator onto the training manifold:
The Manifold Projection Hypothesis (MPH): We empirically observe that deep encoders behave as approximate manifold projectors under distribution shift. Supported by latent density overlap metrics, distance-to-manifold plots, and reconstruction error vs OOD severity, neural networks force out-of-distribution inputs to collapse onto the known training manifold:
This yields the observed density match
Insight: The MPH provides a consistent explanatory hypothesis supported by observed latent collapse behavior. The model forces novelty to look normal, reporting artificially low uncertainty ("fake normalcy").
pinn_model.py- 55-D multi-stream encoder and physics gate.train_maml_pinn.py- Meta-learning loop for zero-shot sim-to-real transfer.physics_loss.py- PDE-constrained loss formulations.
evaluate_ncmapss_adapted.py- N-CMAPSS sim-to-real engine.modern_baselines.py- Native PyTorch implementations of ICLR/AAAI models.streaming_eval.py- Real-time edge latency and throughput profiler.
edl_uncertainty.py&survival_head.py- Probing wrappers for OOD and risk analysis.external_physics_validation.py- Cross-dataset validation against material science data.cert_arp4761_risk_table.py- Safety alignment and compliance metric generation.
git clone https://github.com/GURU1001S/ThermoPINN.git
cd ThermoPINN
pip install -r requirements.txt
# Train the model
python train_maml_pinn.py
# Evaluate on N-CMAPSS
python evaluate_ncmapss_adapted.py-
Train Base Model
python train_maml_pinn.py --epochs 50
-
Run Sim-to-Real Evaluation
python evaluate_ncmapss_adapted.py --dataset DS02
-
Physics Validation
python external_physics_validation.py
To ensure research transparency, all experiments are reproducible under the following configuration:
- Sequence Length: 30 cycles (Sliding Window)
- Batch Size: 256
- Optimizer: Adam (lr = 1e-3, weight_decay = 1e-4)
- Training Epochs: 50 (with Early Stopping)
- Normalization: Per-trajectory Z-score normalization (prevents data leakage)
- Physics Constants:
- Paris Law → m = 3.0
- Arrhenius Activation → Eₐ = 300 kJ/mol
- Hardware: NVIDIA RTX 3050 Laptop GPU (~120 hours total compute)
- Random Seed: 42
All experiments can be reproduced using the provided scripts with fixed seeds and dataset configurations.
ThermoPINN reveals a fundamental gap between predictive accuracy and physical validity in safety-critical ML systems.
While the model achieves strong empirical performance, we provide consistent empirical and theoretical evidence that soft-constrained formulations:
f_phys(z) ≈ 0
are insufficient to guarantee adherence to governing physical laws under partial observability and distribution shift.
Rather than presenting a final solution, ThermoPINN is positioned as a controlled failure case that exposes structural limitations of current PINN methodologies.
Future work should investigate enforcing physics as strict constraints:
z ∈ { z : f_phys(z) = 0 }
or
z = g_ψ(u), where g_ψ ∈ 𝓕_phys
These formulations remove degrees of freedom that enable statistical shortcut learning and may resolve identifiability issues.
The failure to recover domain-invariant constants highlights the need for:
- Symbolic regression heads (explicit equation discovery)
- Structured latent spaces aligned with physical variables
- Hybrid neuro-symbolic models
These ensure representations remain within the true physical function space, not just approximations.
Normalization can distort physics:
- Physics laws are scale-sensitive
- Standard normalization destroys unit consistency
Future systems should use:
x̃ = x / x_ref
or operate directly in physical units to preserve real-world meaning.
Latent physics is fundamentally non-identifiable from limited observations.
Future work should:
- Characterize identifiability conditions
- Quantify inverse ambiguity
- Build architectures robust to latent uncertainty
This connects PINNs to inverse problem theory.
The Manifold Projection Hypothesis (MPH) suggests neural encoders project OOD inputs onto the training manifold, causing:
- False normalcy
- Uncertainty collapse
Future work should:
- Measure manifold projection behavior
- Validate MPH across datasets
- Preserve OOD separability in latent space
For real-world deployment, models must align with:
- DO-178C (avionics software certification)
- ARP4761 (safety assessment)
This requires:
- Physically valid predictions
- Calibrated uncertainty under OOD
- Interpretable degradation trajectories
© 2026 Guru Prasaath S. All Rights Reserved. This code is currently closed-source and provided strictly for academic evaluation. Unauthorized copying, modification, or distribution is prohibited. For collaboration inquiries, please contact me directly.
Progress requires moving beyond correlation-driven learning toward architectures where physics is a first-class structural constraint, not a regularizer.
ThermoPINN serves as:
An empirical foundation for the next generation of physics-consistent, safety-certifiable AI systems.
