Fundy-mental (continued)

I’m looking at side-band variants of the lunisolar orbital forcing because that’s where the data is empirically taking us. I had originally proposed solving Laplace’s Tidal Equations (LTE) using a novel analytical derivation published several years ago (see Mathematical Geoenergy, Wiley/AG, 2019). The takeaway from the math results — given that LTEs form the primitive basis of the GCM-specific shallow-water approximation to oceanic fluid dynamics — was that my solution involved a specific type of non-linear modulation or amplification of the input tidal. However, this isn’t the typical diurnal/semi-diurnal tidal forcing, but because of the slower inertial response of the ocean volume, the targeted tidal cycles are the longer period monthly and annual. Moreover, as very few climate scientists are proficient at signal processing and all the details of aliasing and side-bands, this is an aspect that has remained hidden (again thank Richard Lindzen for opening the book on tidal influences and then slamming it shut for decades).

So, considering the extreme tides at Bay of Fundy in the western Atlantic, I used the side-band draconic lunar cycle of 27.1036 day which explains the 4.53-year Bay of Fundy extreme repeat cycle when applied in conjunction with the perigee cycle of 27.554 days.

365.242 * (1/27.1036 – 1/27.5545) = 1/4.53

(see also section 3.3 on equinoctial tides in https://www.erudit.org/en/journals/ageo/2004-v40-n1-ageo_40_1/ageo40_1art01)

But all the side-bands when aliased against an annual impulse are also likely important.

365.242 * (1/27.1036 – 1/27.5545) mod 1 = 0.2205
365.242 * (1/27.1036 + 1/27.5545) mod 1 = 0.731

365.242 * (1/27.1036 – 2/27.5545) mod 1 = -0.0347
365.242 * (1/27.1036 + 2/27.5545) mod 1 = 0.9863

The 1st is again the 4.53-year period, the 2nd smaller, but the third and fourth relate to the 1st harmonic of the perigee, which occurs due to the pair of inline pulls corresponding to each of the solar and lunar eclipse alignments. The 3rd equates to nearly a 30-year cycle and the 4th a 70-year cycle. Note how close the latter is to the multidecadal AMO cycle.

Now, this isn’t just a selective situation where we can cherry-pick the periods that we want to analyze — they all have to work together when the declination and perigee terms are multiplied together creating all the various cross-harmonic terms. Same as with conventional tidal analysis. That means we will see fast cycles on the order of a year and all the other longer cycles simultaneously if we attempt this kind of fit. And that’s how straightforward it is to model all the short-term and long-term intricacies of the AMO time series. And PDO and ENSO if you go there, first PDO as a perturbation to AMO and then ENSO as a perturbation to PDO.

Tidal forcing is essentially grouping together the declination factors (the first 8 rows below, p=0) and the perigee factors (last 4 rows below, N=0). These groups of sinusoids are multiplied together after adding a constant to each, and then a differential form is calculated. This is basically a Taylor’s series expansion of a tractional force multiplied by the inverse square distance law of gravity, often used as a model for tidal forcing.

Tidal FactorspNTidal FreqAmpPhase
27.3216564110013.36822137-0.0005792480.113447614
27.2122159710113.42198487-0.02642434-13.38684873
27.1036487810213.475748380.5445122245.106707386
13.6608282 (Mf)20026.73644274-0.0147540520.745325851
13.6061079820226.84396975-0.20190355515.78121594
13.6334131920126.79020625-0.074501124-32.72256985
13.5518243920426.951496760.235194217.460943623
13.5789119420326.89773325-0.1879815691.296986592
26.9959444510313.529511880.0012527411.297603014
27.55461332 (Mm)1-1013.255201473.3469265962.836133748
13.777306662-2026.510402951.3583563558.662766548
13.71882022-1026.623422850.74951190234.92423684
27.0926054811013.48124127-1.679928781-2.18904
Tidal factor table

This table is also simplified by removing the annual harmonics, as an annual impulse is convolved with the result.

amo_dtw_2_wowA_unlockT-wow-afterPDO2_highf $env:CLIMATE_INDEX="amo_1870_extend.dat"  

   0.38722949936 :offset:
  -0.60065615118 :bg:
 -10.38509928702 :impA:
  -0.59876284595 :impB:
  -0.09782077176 :impC:
  -4.36913887287:delA:
   0.06559576284:delB:
  -0.32147954266:asym:
  -0.05628779649:ann1:
   0.74270269778:ann2:
  -0.05202962689:sem1:
  -2.38028057471:sem2:
  -0.00139431320:year:
  -0.41055416311:IR:
   0.00000000001 :mA:
   0.00015814003 :mP:
  -0.07959611588 :shiftT:
   0.00000220291 :init:
---- Tidal ----
  27.32166155400,   -0.03300893279,    0.04614934087,  1, -6809,  4.92043575392418E-04
  27.21222081500,   -0.15783570967,  -27.02208599464,  2, -9720,  1.64073093446322E-03
  27.10365333842,    0.68813853648,    5.08586880081,  3,  23947,  2.86165535307149E-03
  13.66083077700,   -0.02731201467,    1.07312566336,  4, -109,  3.15919149301349E-01
  13.60611040750,   -0.45201705077,   14.75632091888,  5, -4629,  9.98077709582378E-03
  13.63341568476,   -0.28954095399,  -28.16602715627,  6, -326,  1.28178306799966E-01
  13.55182666921,    0.47367752322,   21.05812358823,  7,  33319,  1.41740263913067E-03
  13.57891428673,   -0.35270847542,    6.02325282189,  8, -27325,  1.29555306345175E-03
  26.99594871373,    0.06992335671,    0.08567289204,  9,  2963,  2.28268787185689E-03
  27.55454988600,    3.61421159176,    2.66150818812,  10,  4114,  8.57620038125863E-02
  13.77727494300,    1.63003163277,    8.70311029217,  11,  12054,  1.34109849025151E-02
  13.71880577217,    1.02607890622,   29.15740690046,  12,  190603,  5.38051824950004E-04
  27.09267692660,   -2.82285198000,   -2.42825274367,  13, -124333,  2.27221694417265E-03
---- LTE ----
   0.00081513162 :trend:
   0.00000039971 :accel:
   0.00473301364 :K0:
  -1.48271173274 :level:
   0.04621729423,    0.13742791869,    2.64456274999 0
6323.50961360005,    0.06958268813,    2.85962080446 1
82205.62497680062,    0.06750042782,   -1.08933542705 13
```
DTW   0.7838623400   0.4620650814   7 1

The center 100-year interval is used for training. Note that a 72-year cycle naturally arises from the aliased side-band described earlier. The cross-validation is nowhere near perfect but predictively suggests the massive heat spikes of 1878 and last year.

The approach works extremely well with minimal degrees of freedom to achieve cross-validation.

Across climate indices, minimal effort is required to further cross-validate. The PDO is the closest cousin to AMO as it also has a (subtler) decadal variation. In the chart below, the higher-end cross-validation is more impressive.

 pdo_dtw_2_wowA_unlockT-wowAsingle3  $env:CLIMATE_INDEX="amo_1870_extend.dat"
   0.72511909741 :offset:
  -0.87175394952 :bg:
 -34.74740515889 :impA:
  -0.58768101396 :impB:
  -1.41870121295 :impC:
  -4.45619770236:delA:
   0.11967419453:delB:
  -0.29429687155:asym:
  -0.31307316990:ann1:
   0.81228407028:ann2:
  -0.30102232559:sem1:
  -3.63910334475:sem2:
  -0.00139122058:year:
  -0.36770066707:IR:
   0.00304713503 :mA:
  -0.00007130959 :mP:
  -0.07169530430 :shiftT:
   0.00000243443 :init:
---- Tidal ----
  27.32166155400,   -0.02726007756,   -1.04572777592,  1, -5640,  4.92043575392418E-04
  27.21222081500,   -0.19462352908,  -27.45196501208,  2, -11962,  1.64073093446322E-03
  27.10365333842,    0.62248572038,    5.16999600675,  3,  21653,  2.86165535307149E-03
  13.66083077700,   -0.01311189109,    1.07517420791,  4, -104,  3.15919149301349E-01
  13.60611040750,   -0.49971544298,    2.18755427999,  5, -5107,  9.98077709582378E-03
  13.63341568476,   -0.30129871430,  -30.03287312239,  6, -335,  1.28178306799966E-01
  13.55182666921,    0.23462833335,   20.84792609628,  7,  16453,  1.41740263913067E-03
  13.57891428673,   -0.26338557606,    4.38899850087,  8, -20430,  1.29555306345175E-03
  26.99594871373,    0.07578102259,   -0.03720253669,  9,  3220,  2.28268787185689E-03
  27.55454988600,    4.19473679724,    2.72790849966,  10,  4791,  8.57620038125863E-02
  13.77727494300,    1.56693139340,    8.71910714759,  11,  11584,  1.34109849025151E-02
  13.71880577217,    0.81503624561,   41.00457463628,  12,  151379,  5.38051824950004E-04
  27.09267692660,   -2.72795388295,   -2.43925089946,  13, -120157,  2.27221694417265E-03
---- LTE ----
   0.00036802376 :trend:
  -0.00000851792 :accel:
   0.02589779011 :K0:
  -1.14113963527 :level:
   0.04490225722,    1.28468434015,   -0.93176410544 1
   0.58372934392,    0.49804602120,    2.80386939111 13
   0.08980451445,    0.11244009095,    1.94537725758 2
```
DTW   0.7140306465   0.2510907239   5 1

The LTE modulation is the strongest discriminator here, compare the lower right panels of the two charts. Despite being in different ocean basins, the tidal forcing terms do not differ by as much as would be anticipated by the variations in the two time-series. Compare line-by-line the amplitudes for PDO and AMO highlighted as rectangles.

The low DOF in the model enables robust cross-validation. Narrow down the training interval to 1910-1950 in the following chart.

pdo_dtw_2_wowA_unlockT-wowAsingle3-1910-1950

   0.71727947178 :offset:
  -0.79633098011 :bg:
-200.43246360338 :impA:
  -0.58113574661 :impB:
  -0.10987378339 :impC:
  -4.48232068601:delA:
   0.11967419453:delB:
  -0.28445536030:asym:
  -0.08808277756:ann1:
   1.07682695943:ann2:
  -0.04342517779:sem1:
  -5.66855387946:sem2:
  -0.00138814873:year:
  -0.37585884170:IR:
   0.00220316982 :mA:
  -0.00000000000 :mP:
  -0.07169797721 :shiftT:
   0.00000906044 :init:
---- Tidal ----
  27.32166155400,   -0.02726007756,   -1.04572777592,  1, -5640,  4.92043575392418E-04
  27.21222081500,   -0.19462352908,  -27.45196501208,  2, -11962,  1.64073093446322E-03
  27.10365333842,    0.62248572038,    5.16999600675,  3,  21653,  2.86165535307149E-03
  13.66083077700,   -0.01311189109,    1.07517420791,  4, -104,  3.15919149301349E-01
  13.60611040750,   -0.49971544298,    2.18755427999,  5, -5107,  9.98077709582378E-03
  13.63341568476,   -0.30129871430,  -30.03287312239,  6, -335,  1.28178306799966E-01
  13.55182666921,    0.23462833335,   20.84792609628,  7,  16453,  1.41740263913067E-03
  13.57891428673,   -0.26338557606,    4.38899850087,  8, -20430,  1.29555306345175E-03
  26.99594871373,    0.07578102259,   -0.03720253669,  9,  3220,  2.28268787185689E-03
  27.55454988600,    4.19473679724,    2.72790849966,  10,  4791,  8.57620038125863E-02
  13.77727494300,    1.56693139340,    8.71910714759,  11,  11584,  1.34109849025151E-02
  13.71880577217,    0.81503624561,   41.00457463628,  12,  151379,  5.38051824950004E-04
  27.09267692660,   -2.72795388295,   -2.43925089946,  13, -120157,  2.27221694417265E-03
---- LTE ----
   0.00000000000 :trend:
   0.00000000000 :accel:
   0.02185273999 :K0:
  -0.27771917540 :level:
   0.04483524466,    1.26649378997,   -1.00266048452 1
   0.58285818063,    0.85948333972,    2.72746231731 13
   0.31384671265,    0.31343401675,   -1.72759278732 7
```
RMS   0.6031621648   0.3545337843   8 1

with further over-fitting, the out-of-band test interval does not diverge as badly as would occur with models composed of many more DOF. (actually must look closely at the following overfit chart to see any difference to the previous — as an aside, if this was a neural net model, it would wildly diverge)

As PDO shows similarity to ENSO, we can perform a cross-validation to an index such as NINO3, shown below. Although it doesn’t capture the magnitude of the strong El Ninos, it impressively captures the timing of the peaks in the validation interval after the year 2000. It also arguably captures the timing of the twin massive heating spikes of 1878 and last year, which are likely remnants of the same 72-year interval shown more clearly in the AMO model. The LTE modulation is very high for ENSO as can be seen in the lower right panel.

nino3_dtw_2_wowA_unlockT-wowAsingle3-1900-2000b
CLIMATE_INDEX                  nino3_1870.dat
DTW                            4
LOCKT                          false
MODULATION                     false
NLOOPS                         20
TRIGGER                        0.6
TROPMOD                        false

   0.70064368905 :offset:
  -0.79847222770 :bg:
-763.94324524078 :impA:
  -0.58077044030 :impB:
  -0.03034944648 :impC:
  -4.52425123419:delA:
   0.12021255379:delB:
  -0.13798027098:asym:
  -0.26079244684:ann1:
   1.85836611538:ann2:
   0.18454136718:sem1:
 -11.97131620011:sem2:
  -0.00133101319:year:
  -0.63748724230:IR:
   0.00000000554 :mA:
   0.00051030809 :mP:
  -0.07172093677 :shiftT:
  -0.00000003399 :init:
---- Tidal ----
  27.32166155400,   -0.02458037383,   -1.00260278586,  1, -5096,  4.92043575392418E-04
  27.21222081500,   -0.18893576560,  -27.45427291496,  2, -11615,  1.64073093446322E-03
  27.10365333842,    0.62187046626,    5.12651502270,  3,  21631,  2.86165535307149E-03
  13.66083077700,   -0.01326739448,    0.77904612462,  4, -104,  3.15919149301349E-01
  13.60611040750,   -0.49613008608,    2.16760952498,  5, -5071,  9.98077709582378E-03
  13.63341568476,   -0.30578715890,  -30.05051575029,  6, -339,  1.28178306799966E-01
  13.55182666921,    0.30941700170,   21.09938581147,  7,  21730,  1.41740263913067E-03
  13.57891428673,   -0.30899475250,    4.46393885715,  8, -23950,  1.29555306345175E-03
  26.99594871373,    0.08221041340,   -0.16572477582,  9,  3501,  2.28268787185689E-03
  27.55454988600,    4.27030012017,    2.71943246011,  10,  4879,  8.57620038125863E-02
  13.77727494300,    1.57231250550,    8.71147057776,  11,  11624,  1.34109849025151E-02
  13.71880577217,    0.74976606130,   53.65802355674,  12,  139248,  5.38051824950004E-04
  27.09267692660,   -2.67659029039,   -2.47958612557,  13, -117896,  2.27221694417265E-03
---- LTE ----
   0.00000000000 :trend:
   0.00000000000 :accel:
   0.00498051727 :K0:
  -0.08315474544 :level:
   0.04581051917,    0.39065110024,   -0.39764761277 1
   0.45810519170,    0.32064949450,   -1.80352814636 10
   0.36648415336,    0.48308975264,    1.40205871723 8
   6.41347268380,    0.26946198865,   -2.12772114165 140
   6.13860956878,    0.28598169628,    2.17829685529 134
   0.13743155751,    0.10299686766,    0.76364503914 3
```
DTW   0.7551165787   0.5901652076   8 1

In a RealClimate discussion, a commenter PO’27 has been constructively making lots of noise to explain how it can’t work, but that’s not enough — he will have to show how the excellent cross-validation results across all the climate indices — QBO, AMO, PDO, ENSO and the small scale Bay of Fundy results — can occur just by statistical chance. Good luck with that. As PO’27 was also asking about the physics, this is about as close as one can get — physics is about creating a unified view of plausible behavior that is both precise and parsimonious.

I can imagine that machine-learning will also discover the cross-validation eventually but the challenge there will be to reverse engineer the results. Fortunately, that’s something we don’t have to do here, as the analysis was physics-first.

One thought on “Fundy-mental (continued)

Leave a Reply