== Physical Plan ==
TakeOrderedAndProject (71)
+- * Filter (70)
   +- * HashAggregate (69)
      +- * HashAggregate (68)
         +- * Project (67)
            +- * BroadcastHashJoin Inner BuildRight (66)
               :- Window (60)
               :  +- * Sort (59)
               :     +- Exchange (58)
               :        +- * Project (57)
               :           +- * Filter (56)
               :              +- * SortMergeJoin FullOuter (55)
               :                 :- * Sort (29)
               :                 :  +- Exchange (28)
               :                 :     +- * HashAggregate (27)
               :                 :        +- Exchange (26)
               :                 :           +- * HashAggregate (25)
               :                 :              +- * Project (24)
               :                 :                 +- * BroadcastHashJoin Inner BuildRight (23)
               :                 :                    :- * Project (17)
               :                 :                    :  +- Window (16)
               :                 :                    :     +- * Sort (15)
               :                 :                    :        +- Exchange (14)
               :                 :                    :           +- * HashAggregate (13)
               :                 :                    :              +- Exchange (12)
               :                 :                    :                 +- * HashAggregate (11)
               :                 :                    :                    +- * Project (10)
               :                 :                    :                       +- * BroadcastHashJoin Inner BuildRight (9)
               :                 :                    :                          :- * Filter (3)
               :                 :                    :                          :  +- * ColumnarToRow (2)
               :                 :                    :                          :     +- Scan parquet spark_catalog.default.web_sales (1)
               :                 :                    :                          +- BroadcastExchange (8)
               :                 :                    :                             +- * Project (7)
               :                 :                    :                                +- * Filter (6)
               :                 :                    :                                   +- * ColumnarToRow (5)
               :                 :                    :                                      +- Scan parquet spark_catalog.default.date_dim (4)
               :                 :                    +- BroadcastExchange (22)
               :                 :                       +- * Project (21)
               :                 :                          +- Window (20)
               :                 :                             +- * Sort (19)
               :                 :                                +- ReusedExchange (18)
               :                 +- * Sort (54)
               :                    +- Exchange (53)
               :                       +- * HashAggregate (52)
               :                          +- Exchange (51)
               :                             +- * HashAggregate (50)
               :                                +- * Project (49)
               :                                   +- * BroadcastHashJoin Inner BuildRight (48)
               :                                      :- * Project (42)
               :                                      :  +- Window (41)
               :                                      :     +- * Sort (40)
               :                                      :        +- Exchange (39)
               :                                      :           +- * HashAggregate (38)
               :                                      :              +- Exchange (37)
               :                                      :                 +- * HashAggregate (36)
               :                                      :                    +- * Project (35)
               :                                      :                       +- * BroadcastHashJoin Inner BuildRight (34)
               :                                      :                          :- * Filter (32)
               :                                      :                          :  +- * ColumnarToRow (31)
               :                                      :                          :     +- Scan parquet spark_catalog.default.store_sales (30)
               :                                      :                          +- ReusedExchange (33)
               :                                      +- BroadcastExchange (47)
               :                                         +- * Project (46)
               :                                            +- Window (45)
               :                                               +- * Sort (44)
               :                                                  +- ReusedExchange (43)
               +- BroadcastExchange (65)
                  +- * Project (64)
                     +- Window (63)
                        +- * Sort (62)
                           +- ReusedExchange (61)


(1) Scan parquet spark_catalog.default.web_sales
Output [3]: [ws_item_sk#1, ws_sales_price#2, ws_sold_date_sk#3]
Batched: true
Location: InMemoryFileIndex []
PartitionFilters: [isnotnull(ws_sold_date_sk#3)]
PushedFilters: [IsNotNull(ws_item_sk)]
ReadSchema: struct<ws_item_sk:int,ws_sales_price:decimal(7,2)>

(2) ColumnarToRow [codegen id : 2]
Input [3]: [ws_item_sk#1, ws_sales_price#2, ws_sold_date_sk#3]

(3) Filter [codegen id : 2]
Input [3]: [ws_item_sk#1, ws_sales_price#2, ws_sold_date_sk#3]
Condition : isnotnull(ws_item_sk#1)

(4) Scan parquet spark_catalog.default.date_dim
Output [3]: [d_date_sk#4, d_date#5, d_month_seq#6]
Batched: true
Location [not included in comparison]/{warehouse_dir}/date_dim]
PushedFilters: [IsNotNull(d_month_seq), GreaterThanOrEqual(d_month_seq,1212), LessThanOrEqual(d_month_seq,1223), IsNotNull(d_date_sk)]
ReadSchema: struct<d_date_sk:int,d_date:date,d_month_seq:int>

(5) ColumnarToRow [codegen id : 1]
Input [3]: [d_date_sk#4, d_date#5, d_month_seq#6]

(6) Filter [codegen id : 1]
Input [3]: [d_date_sk#4, d_date#5, d_month_seq#6]
Condition : (((isnotnull(d_month_seq#6) AND (d_month_seq#6 >= 1212)) AND (d_month_seq#6 <= 1223)) AND isnotnull(d_date_sk#4))

(7) Project [codegen id : 1]
Output [2]: [d_date_sk#4, d_date#5]
Input [3]: [d_date_sk#4, d_date#5, d_month_seq#6]

(8) BroadcastExchange
Input [2]: [d_date_sk#4, d_date#5]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [plan_id=1]

(9) BroadcastHashJoin [codegen id : 2]
Left keys [1]: [ws_sold_date_sk#3]
Right keys [1]: [d_date_sk#4]
Join type: Inner
Join condition: None

(10) Project [codegen id : 2]
Output [3]: [ws_item_sk#1, ws_sales_price#2, d_date#5]
Input [5]: [ws_item_sk#1, ws_sales_price#2, ws_sold_date_sk#3, d_date_sk#4, d_date#5]

(11) HashAggregate [codegen id : 2]
Input [3]: [ws_item_sk#1, ws_sales_price#2, d_date#5]
Keys [2]: [ws_item_sk#1, d_date#5]
Functions [1]: [partial_sum(UnscaledValue(ws_sales_price#2))]
Aggregate Attributes [1]: [sum#7]
Results [3]: [ws_item_sk#1, d_date#5, sum#8]

(12) Exchange
Input [3]: [ws_item_sk#1, d_date#5, sum#8]
Arguments: hashpartitioning(ws_item_sk#1, d_date#5, 5), ENSURE_REQUIREMENTS, [plan_id=2]

(13) HashAggregate [codegen id : 3]
Input [3]: [ws_item_sk#1, d_date#5, sum#8]
Keys [2]: [ws_item_sk#1, d_date#5]
Functions [1]: [sum(UnscaledValue(ws_sales_price#2))]
Aggregate Attributes [1]: [sum(UnscaledValue(ws_sales_price#2))#9]
Results [4]: [ws_item_sk#1 AS item_sk#10, d_date#5, MakeDecimal(sum(UnscaledValue(ws_sales_price#2))#9,17,2) AS sumws#11, ws_item_sk#1]

(14) Exchange
Input [4]: [item_sk#10, d_date#5, sumws#11, ws_item_sk#1]
Arguments: hashpartitioning(ws_item_sk#1, 5), ENSURE_REQUIREMENTS, [plan_id=3]

(15) Sort [codegen id : 4]
Input [4]: [item_sk#10, d_date#5, sumws#11, ws_item_sk#1]
Arguments: [ws_item_sk#1 ASC NULLS FIRST, d_date#5 ASC NULLS FIRST], false, 0

(16) Window
Input [4]: [item_sk#10, d_date#5, sumws#11, ws_item_sk#1]
Arguments: [row_number() windowspecdefinition(ws_item_sk#1, d_date#5 ASC NULLS FIRST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rk#12], [ws_item_sk#1], [d_date#5 ASC NULLS FIRST]

(17) Project [codegen id : 10]
Output [4]: [item_sk#10, d_date#5, sumws#11, rk#12]
Input [5]: [item_sk#10, d_date#5, sumws#11, ws_item_sk#1, rk#12]

(18) ReusedExchange [Reuses operator id: 14]
Output [4]: [item_sk#10, d_date#13, sumws#11, ws_item_sk#14]

(19) Sort [codegen id : 8]
Input [4]: [item_sk#10, d_date#13, sumws#11, ws_item_sk#14]
Arguments: [ws_item_sk#14 ASC NULLS FIRST, d_date#13 ASC NULLS FIRST], false, 0

(20) Window
Input [4]: [item_sk#10, d_date#13, sumws#11, ws_item_sk#14]
Arguments: [row_number() windowspecdefinition(ws_item_sk#14, d_date#13 ASC NULLS FIRST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rk#15], [ws_item_sk#14], [d_date#13 ASC NULLS FIRST]

(21) Project [codegen id : 9]
Output [3]: [item_sk#10 AS item_sk#16, sumws#11 AS sumws#17, rk#15]
Input [5]: [item_sk#10, d_date#13, sumws#11, ws_item_sk#14, rk#15]

(22) BroadcastExchange
Input [3]: [item_sk#16, sumws#17, rk#15]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [plan_id=4]

(23) BroadcastHashJoin [codegen id : 10]
Left keys [1]: [item_sk#10]
Right keys [1]: [item_sk#16]
Join type: Inner
Join condition: (rk#12 >= rk#15)

(24) Project [codegen id : 10]
Output [4]: [item_sk#10, d_date#5, sumws#11, sumws#17]
Input [7]: [item_sk#10, d_date#5, sumws#11, rk#12, item_sk#16, sumws#17, rk#15]

(25) HashAggregate [codegen id : 10]
Input [4]: [item_sk#10, d_date#5, sumws#11, sumws#17]
Keys [3]: [item_sk#10, d_date#5, sumws#11]
Functions [1]: [partial_sum(sumws#17)]
Aggregate Attributes [2]: [sum#18, isEmpty#19]
Results [5]: [item_sk#10, d_date#5, sumws#11, sum#20, isEmpty#21]

(26) Exchange
Input [5]: [item_sk#10, d_date#5, sumws#11, sum#20, isEmpty#21]
Arguments: hashpartitioning(item_sk#10, d_date#5, sumws#11, 5), ENSURE_REQUIREMENTS, [plan_id=5]

(27) HashAggregate [codegen id : 11]
Input [5]: [item_sk#10, d_date#5, sumws#11, sum#20, isEmpty#21]
Keys [3]: [item_sk#10, d_date#5, sumws#11]
Functions [1]: [sum(sumws#17)]
Aggregate Attributes [1]: [sum(sumws#17)#22]
Results [3]: [item_sk#10, d_date#5, sum(sumws#17)#22 AS cume_sales#23]

(28) Exchange
Input [3]: [item_sk#10, d_date#5, cume_sales#23]
Arguments: hashpartitioning(item_sk#10, d_date#5, 5), ENSURE_REQUIREMENTS, [plan_id=6]

(29) Sort [codegen id : 12]
Input [3]: [item_sk#10, d_date#5, cume_sales#23]
Arguments: [item_sk#10 ASC NULLS FIRST, d_date#5 ASC NULLS FIRST], false, 0

(30) Scan parquet spark_catalog.default.store_sales
Output [3]: [ss_item_sk#24, ss_sales_price#25, ss_sold_date_sk#26]
Batched: true
Location: InMemoryFileIndex []
PartitionFilters: [isnotnull(ss_sold_date_sk#26)]
PushedFilters: [IsNotNull(ss_item_sk)]
ReadSchema: struct<ss_item_sk:int,ss_sales_price:decimal(7,2)>

(31) ColumnarToRow [codegen id : 14]
Input [3]: [ss_item_sk#24, ss_sales_price#25, ss_sold_date_sk#26]

(32) Filter [codegen id : 14]
Input [3]: [ss_item_sk#24, ss_sales_price#25, ss_sold_date_sk#26]
Condition : isnotnull(ss_item_sk#24)

(33) ReusedExchange [Reuses operator id: 8]
Output [2]: [d_date_sk#27, d_date#28]

(34) BroadcastHashJoin [codegen id : 14]
Left keys [1]: [ss_sold_date_sk#26]
Right keys [1]: [d_date_sk#27]
Join type: Inner
Join condition: None

(35) Project [codegen id : 14]
Output [3]: [ss_item_sk#24, ss_sales_price#25, d_date#28]
Input [5]: [ss_item_sk#24, ss_sales_price#25, ss_sold_date_sk#26, d_date_sk#27, d_date#28]

(36) HashAggregate [codegen id : 14]
Input [3]: [ss_item_sk#24, ss_sales_price#25, d_date#28]
Keys [2]: [ss_item_sk#24, d_date#28]
Functions [1]: [partial_sum(UnscaledValue(ss_sales_price#25))]
Aggregate Attributes [1]: [sum#29]
Results [3]: [ss_item_sk#24, d_date#28, sum#30]

(37) Exchange
Input [3]: [ss_item_sk#24, d_date#28, sum#30]
Arguments: hashpartitioning(ss_item_sk#24, d_date#28, 5), ENSURE_REQUIREMENTS, [plan_id=7]

(38) HashAggregate [codegen id : 15]
Input [3]: [ss_item_sk#24, d_date#28, sum#30]
Keys [2]: [ss_item_sk#24, d_date#28]
Functions [1]: [sum(UnscaledValue(ss_sales_price#25))]
Aggregate Attributes [1]: [sum(UnscaledValue(ss_sales_price#25))#31]
Results [4]: [ss_item_sk#24 AS item_sk#32, d_date#28, MakeDecimal(sum(UnscaledValue(ss_sales_price#25))#31,17,2) AS sumss#33, ss_item_sk#24]

(39) Exchange
Input [4]: [item_sk#32, d_date#28, sumss#33, ss_item_sk#24]
Arguments: hashpartitioning(ss_item_sk#24, 5), ENSURE_REQUIREMENTS, [plan_id=8]

(40) Sort [codegen id : 16]
Input [4]: [item_sk#32, d_date#28, sumss#33, ss_item_sk#24]
Arguments: [ss_item_sk#24 ASC NULLS FIRST, d_date#28 ASC NULLS FIRST], false, 0

(41) Window
Input [4]: [item_sk#32, d_date#28, sumss#33, ss_item_sk#24]
Arguments: [row_number() windowspecdefinition(ss_item_sk#24, d_date#28 ASC NULLS FIRST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rk#34], [ss_item_sk#24], [d_date#28 ASC NULLS FIRST]

(42) Project [codegen id : 22]
Output [4]: [item_sk#32, d_date#28, sumss#33, rk#34]
Input [5]: [item_sk#32, d_date#28, sumss#33, ss_item_sk#24, rk#34]

(43) ReusedExchange [Reuses operator id: 39]
Output [4]: [item_sk#32, d_date#35, sumss#33, ss_item_sk#36]

(44) Sort [codegen id : 20]
Input [4]: [item_sk#32, d_date#35, sumss#33, ss_item_sk#36]
Arguments: [ss_item_sk#36 ASC NULLS FIRST, d_date#35 ASC NULLS FIRST], false, 0

(45) Window
Input [4]: [item_sk#32, d_date#35, sumss#33, ss_item_sk#36]
Arguments: [row_number() windowspecdefinition(ss_item_sk#36, d_date#35 ASC NULLS FIRST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rk#37], [ss_item_sk#36], [d_date#35 ASC NULLS FIRST]

(46) Project [codegen id : 21]
Output [3]: [item_sk#32 AS item_sk#38, sumss#33 AS sumss#39, rk#37]
Input [5]: [item_sk#32, d_date#35, sumss#33, ss_item_sk#36, rk#37]

(47) BroadcastExchange
Input [3]: [item_sk#38, sumss#39, rk#37]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [plan_id=9]

(48) BroadcastHashJoin [codegen id : 22]
Left keys [1]: [item_sk#32]
Right keys [1]: [item_sk#38]
Join type: Inner
Join condition: (rk#34 >= rk#37)

(49) Project [codegen id : 22]
Output [4]: [item_sk#32, d_date#28, sumss#33, sumss#39]
Input [7]: [item_sk#32, d_date#28, sumss#33, rk#34, item_sk#38, sumss#39, rk#37]

(50) HashAggregate [codegen id : 22]
Input [4]: [item_sk#32, d_date#28, sumss#33, sumss#39]
Keys [3]: [item_sk#32, d_date#28, sumss#33]
Functions [1]: [partial_sum(sumss#39)]
Aggregate Attributes [2]: [sum#40, isEmpty#41]
Results [5]: [item_sk#32, d_date#28, sumss#33, sum#42, isEmpty#43]

(51) Exchange
Input [5]: [item_sk#32, d_date#28, sumss#33, sum#42, isEmpty#43]
Arguments: hashpartitioning(item_sk#32, d_date#28, sumss#33, 5), ENSURE_REQUIREMENTS, [plan_id=10]

(52) HashAggregate [codegen id : 23]
Input [5]: [item_sk#32, d_date#28, sumss#33, sum#42, isEmpty#43]
Keys [3]: [item_sk#32, d_date#28, sumss#33]
Functions [1]: [sum(sumss#39)]
Aggregate Attributes [1]: [sum(sumss#39)#44]
Results [3]: [item_sk#32, d_date#28, sum(sumss#39)#44 AS cume_sales#45]

(53) Exchange
Input [3]: [item_sk#32, d_date#28, cume_sales#45]
Arguments: hashpartitioning(item_sk#32, d_date#28, 5), ENSURE_REQUIREMENTS, [plan_id=11]

(54) Sort [codegen id : 24]
Input [3]: [item_sk#32, d_date#28, cume_sales#45]
Arguments: [item_sk#32 ASC NULLS FIRST, d_date#28 ASC NULLS FIRST], false, 0

(55) SortMergeJoin [codegen id : 25]
Left keys [2]: [item_sk#10, d_date#5]
Right keys [2]: [item_sk#32, d_date#28]
Join type: FullOuter
Join condition: None

(56) Filter [codegen id : 25]
Input [6]: [item_sk#10, d_date#5, cume_sales#23, item_sk#32, d_date#28, cume_sales#45]
Condition : isnotnull(CASE WHEN isnotnull(item_sk#10) THEN item_sk#10 ELSE item_sk#32 END)

(57) Project [codegen id : 25]
Output [4]: [CASE WHEN isnotnull(item_sk#10) THEN item_sk#10 ELSE item_sk#32 END AS item_sk#46, CASE WHEN isnotnull(d_date#5) THEN d_date#5 ELSE d_date#28 END AS d_date#47, cume_sales#23 AS web_sales#48, cume_sales#45 AS store_sales#49]
Input [6]: [item_sk#10, d_date#5, cume_sales#23, item_sk#32, d_date#28, cume_sales#45]

(58) Exchange
Input [4]: [item_sk#46, d_date#47, web_sales#48, store_sales#49]
Arguments: hashpartitioning(item_sk#46, 5), ENSURE_REQUIREMENTS, [plan_id=12]

(59) Sort [codegen id : 26]
Input [4]: [item_sk#46, d_date#47, web_sales#48, store_sales#49]
Arguments: [item_sk#46 ASC NULLS FIRST, d_date#47 ASC NULLS FIRST], false, 0

(60) Window
Input [4]: [item_sk#46, d_date#47, web_sales#48, store_sales#49]
Arguments: [row_number() windowspecdefinition(item_sk#46, d_date#47 ASC NULLS FIRST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rk#50], [item_sk#46], [d_date#47 ASC NULLS FIRST]

(61) ReusedExchange [Reuses operator id: 58]
Output [4]: [item_sk#46, d_date#47, web_sales#48, store_sales#49]

(62) Sort [codegen id : 52]
Input [4]: [item_sk#46, d_date#47, web_sales#48, store_sales#49]
Arguments: [item_sk#46 ASC NULLS FIRST, d_date#47 ASC NULLS FIRST], false, 0

(63) Window
Input [4]: [item_sk#46, d_date#47, web_sales#48, store_sales#49]
Arguments: [row_number() windowspecdefinition(item_sk#46, d_date#47 ASC NULLS FIRST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS rk#51], [item_sk#46], [d_date#47 ASC NULLS FIRST]

(64) Project [codegen id : 53]
Output [4]: [item_sk#46 AS item_sk#52, web_sales#48 AS web_sales#53, store_sales#49 AS store_sales#54, rk#51]
Input [5]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, rk#51]

(65) BroadcastExchange
Input [4]: [item_sk#52, web_sales#53, store_sales#54, rk#51]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [plan_id=13]

(66) BroadcastHashJoin [codegen id : 54]
Left keys [1]: [item_sk#46]
Right keys [1]: [item_sk#52]
Join type: Inner
Join condition: (rk#50 >= rk#51)

(67) Project [codegen id : 54]
Output [6]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, web_sales#53, store_sales#54]
Input [9]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, rk#50, item_sk#52, web_sales#53, store_sales#54, rk#51]

(68) HashAggregate [codegen id : 54]
Input [6]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, web_sales#53, store_sales#54]
Keys [4]: [item_sk#46, d_date#47, web_sales#48, store_sales#49]
Functions [2]: [partial_max(web_sales#53), partial_max(store_sales#54)]
Aggregate Attributes [2]: [max#55, max#56]
Results [6]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, max#57, max#58]

(69) HashAggregate [codegen id : 54]
Input [6]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, max#57, max#58]
Keys [4]: [item_sk#46, d_date#47, web_sales#48, store_sales#49]
Functions [2]: [max(web_sales#53), max(store_sales#54)]
Aggregate Attributes [2]: [max(web_sales#53)#59, max(store_sales#54)#60]
Results [6]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, max(web_sales#53)#59 AS web_cumulative#61, max(store_sales#54)#60 AS store_cumulative#62]

(70) Filter [codegen id : 54]
Input [6]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, web_cumulative#61, store_cumulative#62]
Condition : ((isnotnull(web_cumulative#61) AND isnotnull(store_cumulative#62)) AND (web_cumulative#61 > store_cumulative#62))

(71) TakeOrderedAndProject
Input [6]: [item_sk#46, d_date#47, web_sales#48, store_sales#49, web_cumulative#61, store_cumulative#62]
Arguments: 100, [item_sk#46 ASC NULLS FIRST, d_date#47 ASC NULLS FIRST], [item_sk#46, d_date#47, web_sales#48, store_sales#49, web_cumulative#61, store_cumulative#62]

