[SYSTEMDS-3835] Add physiological representations to Scuro #2598

Merged
christinadionysio opened 7:48am on August 26, 2026 wanted to merge 1627 Δ into apache/systemds main from
physiological_reps

Pull request #2598 quality checks

Code files and functions touched by this pull request are analyzed below.

Quality targets

How does this pull request compare to chosen code quality targets? Read more about code quality targets.

Target name Target value This PR
Maximum Diff Delta per PR 500 1627
Maximum comment count per PR 10 0
Pull request maximum business days between activity 3 18
Pull request maximum business days open 5 18

Coupled files

Are there any files from this commit that are always committed alongside another file? This often suggests that there exists code coupling to potentially remove. Read more about code coupling

Committed together % Code file
Coupled code file
Commits in PR with both
100 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/mfcc.py
1
100 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/bert.py
1
100 src/main/python/systemds/scuro/representations/hadamard.py
src/main/python/systemds/scuro/representations/concatenation.py
1
100 src/main/python/systemds/scuro/representations/hadamard.py
src/main/python/systemds/scuro/representations/sum.py
1
100 src/main/python/systemds/scuro/representations/glove.py
src/main/python/systemds/scuro/representations/word2vec.py
1
100 src/main/python/systemds/scuro/representations/glove.py
src/main/python/systemds/scuro/representations/bow.py
1
100 src/main/python/systemds/scuro/representations/glove.py
src/main/python/systemds/scuro/representations/bert.py
1
100 src/main/python/systemds/scuro/representations/clip.py
src/main/python/systemds/scuro/representations/bert.py
1
100 src/main/python/systemds/scuro/representations/bow.py
src/main/python/systemds/scuro/representations/tfidf.py
1
100 src/main/python/systemds/scuro/representations/utils.py
src/main/python/systemds/scuro/representations/bert.py
1
100 src/main/python/systemds/scuro/representations/sum.py
src/main/python/systemds/scuro/representations/concatenation.py
1
100 src/main/python/systemds/scuro/representations/fusion.py
src/main/python/systemds/scuro/representations/bert.py
1
100 src/main/python/systemds/scuro/representations/average.py
src/main/python/systemds/scuro/representations/sum.py
1
100 src/main/python/systemds/scuro/representations/average.py
src/main/python/systemds/scuro/representations/concatenation.py
1
96 src/main/python/systemds/scuro/representations/bow.py
src/main/python/systemds/scuro/representations/bert.py
1
96 src/main/python/systemds/scuro/representations/word2vec.py
src/main/python/systemds/scuro/representations/tfidf.py
1
94 src/main/python/systemds/scuro/representations/glove.py
src/main/python/systemds/scuro/representations/tfidf.py
1
92 src/main/python/systemds/scuro/representations/tfidf.py
src/main/python/systemds/scuro/representations/bow.py
1
92 src/main/python/systemds/scuro/representations/concatenation.py
src/main/python/systemds/scuro/representations/sum.py
1
89 src/main/python/systemds/scuro/representations/tfidf.py
src/main/python/systemds/scuro/representations/word2vec.py
1
88 src/main/python/systemds/scuro/representations/bow.py
src/main/python/systemds/scuro/representations/word2vec.py
1
88 src/main/python/systemds/scuro/representations/word2vec.py
src/main/python/systemds/scuro/representations/bert.py
1
88 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/word2vec.py
1
88 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/clip.py
1
87 src/main/python/systemds/scuro/representations/text_context_with_indices.py
src/main/python/systemds/scuro/representations/clip.py
1
87 src/main/python/systemds/scuro/representations/text_context_with_indices.py
src/main/python/systemds/scuro/representations/window_aggregation.py
1
84 src/main/python/systemds/scuro/representations/word2vec.py
src/main/python/systemds/scuro/representations/bow.py
1
83 src/main/python/systemds/scuro/representations/fusion.py
src/main/python/systemds/scuro/representations/average.py
1
83 src/main/python/systemds/scuro/representations/fusion.py
src/main/python/systemds/scuro/representations/word2vec.py
1
83 src/main/python/systemds/scuro/representations/fusion.py
src/main/python/systemds/scuro/representations/tfidf.py
1
83 src/main/python/systemds/scuro/representations/fusion.py
src/main/python/systemds/scuro/representations/bow.py
1
82 src/main/python/systemds/scuro/representations/tfidf.py
src/main/python/systemds/scuro/representations/bert.py
1
81 src/main/python/systemds/scuro/representations/mfcc.py
src/main/python/systemds/scuro/representations/window_aggregation.py
1
81 src/main/python/systemds/scuro/representations/mfcc.py
src/main/python/systemds/scuro/representations/wav2vec.py
1
80 src/main/python/systemds/scuro/representations/sum.py
src/main/python/systemds/scuro/representations/average.py
1
80 src/main/python/systemds/scuro/representations/hadamard.py
src/main/python/systemds/scuro/representations/timeseries_representations.py
1
80 src/main/python/systemds/scuro/representations/hadamard.py
src/main/python/systemds/scuro/representations/mlp_averaging.py
1
80 src/main/python/systemds/scuro/representations/hadamard.py
src/main/python/systemds/scuro/representations/aggregate.py
1
80 src/main/python/systemds/scuro/representations/hadamard.py
src/main/python/systemds/scuro/representations/window_aggregation.py
1
77 src/main/python/systemds/scuro/representations/bert.py
src/main/python/systemds/scuro/representations/bow.py
1
77 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/glove.py
1
76 src/main/python/systemds/scuro/representations/aggregate.py
src/main/python/systemds/scuro/representations/bert.py
1
76 src/main/python/systemds/scuro/representations/aggregate.py
src/main/python/systemds/scuro/representations/bow.py
1
76 src/main/python/systemds/scuro/representations/aggregate.py
src/main/python/systemds/scuro/representations/tfidf.py
1
76 src/main/python/systemds/scuro/representations/concatenation.py
src/main/python/systemds/scuro/representations/average.py
1
75 src/main/python/systemds/scuro/representations/text_context_with_indices.py
src/main/python/systemds/scuro/representations/mlp_averaging.py
1
75 src/main/python/systemds/scuro/representations/text_context_with_indices.py
src/main/python/systemds/scuro/representations/word2vec.py
1
75 src/main/python/systemds/scuro/representations/text_context_with_indices.py
src/main/python/systemds/scuro/representations/tfidf.py
1
75 src/main/python/systemds/scuro/representations/text_context_with_indices.py
src/main/python/systemds/scuro/representations/bert.py
1
75 src/main/python/systemds/scuro/representations/text_context_with_indices.py
src/main/python/systemds/scuro/representations/bow.py
1
75 src/main/python/systemds/scuro/representations/text_context_with_indices.py
src/main/python/systemds/scuro/representations/glove.py
1
74 src/main/python/systemds/scuro/representations/bert.py
src/main/python/systemds/scuro/representations/word2vec.py
1
74 src/main/python/systemds/scuro/representations/bert.py
src/main/python/systemds/scuro/representations/tfidf.py
1
73 src/main/python/systemds/scuro/representations/word2vec.py
src/main/python/systemds/scuro/representations/glove.py
1
72 src/main/python/systemds/scuro/representations/mlp_averaging.py
src/main/python/systemds/scuro/representations/clip.py
1
72 src/main/python/systemds/scuro/representations/mlp_averaging.py
src/main/python/systemds/scuro/representations/window_aggregation.py
1
72 src/main/python/systemds/scuro/representations/mlp_averaging.py
src/main/python/systemds/scuro/representations/bert.py
1
72 src/main/python/systemds/scuro/representations/mfcc.py
src/main/python/systemds/scuro/representations/bert.py
1
72 src/main/python/systemds/scuro/representations/mfcc.py
src/main/python/systemds/scuro/representations/bow.py
1
72 src/main/python/systemds/scuro/representations/mfcc.py
src/main/python/systemds/scuro/representations/tfidf.py
1
71 src/main/python/systemds/scuro/representations/clip.py
src/main/python/systemds/scuro/representations/glove.py
1
71 src/main/python/tests/scuro/test_operator_registry.py
src/main/python/systemds/scuro/representations/word2vec.py
1
71 src/main/python/tests/scuro/test_operator_registry.py
src/main/python/systemds/scuro/representations/tfidf.py
1
71 src/main/python/tests/scuro/test_operator_registry.py
src/main/python/systemds/scuro/representations/bow.py
1
71 src/main/python/tests/scuro/test_operator_registry.py
src/main/python/systemds/scuro/representations/bert.py
1
70 src/main/python/systemds/scuro/representations/sum.py
src/main/python/systemds/scuro/representations/bert.py
1

Biggest files changes in pull request

Path View whole file Lines removed Lines added Final line count
src/main/python/systemds/scuro/representations/bow.py 2 12 92
src/main/python/systemds/scuro/representations/average.py 1 28 51
src/main/python/systemds/scuro/representations/window_aggregation.py 6 108 712
src/main/python/tests/scuro/test_operator_registry.py 0 12 155
src/main/python/systemds/scuro/representations/aggregate.py 0 0 161
src/main/python/systemds/scuro/representations/timeseries_representations.py 18 210 491
src/main/python/systemds/scuro/dataloader/tabular_loader.py 0 78 78
src/main/python/systemds/scuro/representations/glove.py 0 2 106
src/main/python/systemds/scuro/representations/physiological_window.py 0 260 260
src/main/python/systemds/scuro/representations/tabular_features.py 0 59 59
src/main/python/systemds/scuro/representations/word2vec.py 0 2 97
src/main/python/systemds/scuro/representations/clip.py 0 8 543
src/main/python/systemds/scuro/representations/concatenation.py 26 85 164
src/main/python/systemds/scuro/representations/tfidf.py 1 4 76
src/main/python/systemds/scuro/representations/fusion.py 1 69 213
src/main/python/systemds/scuro/representations/bert.py 0 2 488
src/main/python/systemds/scuro/representations/mlp_averaging.py 4 10 190
src/main/python/systemds/scuro/representations/text_context_with_indices.py 0 2 384
src/main/python/systemds/scuro/representations/sum.py 20 17 84
src/main/python/systemds/scuro/representations/hadamard.py 18 17 76
src/main/python/systemds/scuro/representations/wav2vec.py 6 26 107
src/main/python/systemds/scuro/representations/physiological_representations.py 0 641 641
src/main/python/systemds/scuro/representations/utils.py 0 23 73
src/main/python/systemds/scuro/representations/mfcc.py 0 0 179

️ Biggest functions grown or shrunk by pull request

Which functions had their line count change as part of this pull request?

Qualified function name View whole function Lines removed Lines added Final line count
Representation::UnimodalRepresentation::CLIPText::get_output_stats 0 4 22
Representation::UnimodalRepresentation::BoW::transform 0 3 22
Representation::UnimodalRepresentation::BertFamily::get_output_stats 0 2 22
Representation::UnimodalRepresentation::dense_instance_batch 0 23 20
Representation::UnimodalRepresentation::CLIPVisual::get_output_stats 0 4 20
TabularLoader::__init__ 0 19 17
Hadamard::get_output_stats 6 10 15
Sum::get_output_stats 6 10 15
Average::get_output_stats 0 16 14
Representation::UnimodalRepresentation::BoW::get_output_stats 0 5 14
OverlappingSplitIndices::get_output_stats 0 1 14
SentenceBoundarySplitIndices::get_output_stats 0 1 14
TabularLoader::__init__::extract 0 12 10
Representation::UnimodalRepresentation::TfIdf::get_output_stats 0 4 10
Average::estimate_peak_memory_bytes 0 10 9
Sum::estimate_peak_memory_bytes 0 7 9
Hadamard::estimate_peak_memory_bytes 0 7 9
Concatenation::__init__ 0 9 8
Average::execute 0 1 7
Representation::UnimodalRepresentation::TabularFeatures::estimate_output_memory_bytes 0 7 5
Representation::UnimodalRepresentation::TabularFeatures::transform 0 5 4
Representation::UnimodalRepresentation::TabularFeatures::estimate_peak_memory_bytes 0 3 4
Representation::UnimodalRepresentation::GloVe::get_output_stats 0 2 4
Representation::UnimodalRepresentation::W2V::get_output_stats 0 2 4
Representation::UnimodalRepresentation::TabularFeatures::get_output_stats 0 5 3
Concatenation::get_current_parameters 0 5 3
Representation::UnimodalRepresentation::TabularFeatures::__init__ 0 4 2
TabularLoader::__init__::get_stats 0 10 ---
Hadamard::estimate_peak_memory_bytes::stats_payload_bytes 3 0 ---
Sum::estimate_peak_memory_bytes::stats_payload_bytes 3 0 ---
Sum::estimate_peak_memory_bytes 3 0 ---
Hadamard::estimate_peak_memory_bytes 2 0 ---