Home » Oreps » Systemds » All Pull Requests » #2603
apache/systemds
An open source ML system for the end-to-end data science lifecycle
Watch
1
Commit Activity
Pull Requests
Directory Browser
Velocity History
Releases

[SYSTEMDS-3947] Add Caching mechanism to HP Tuner #2603

Compare code on GitHub
Merged
christinadionysio opened 12:05pm on September 1, 2026 wanted to merge 590 Δ into apache/systemds main from
hpo_cache

Pull request #2603 quality checks

Code files and functions touched by this pull request are analyzed below.

Quality targets

How does this pull request compare to chosen code quality targets? Read more about code quality targets.

Target name Target value This PR
Maximum Diff Delta per PR 500 590
Maximum comment count per PR 10 0
Pull request maximum business days between activity 3 14
Pull request maximum business days open 5 14

Coupled files

Are there any files from this commit that are always committed alongside another file? This often suggests that there exists code coupling to potentially remove. Read more about code coupling

Committed together % Code file
Coupled code file 		Commits in PR with both
100 src/main/python/systemds/scuro/representations/image_bind.py
src/main/python/systemds/scuro/representations/bert.py 		2
100 src/main/python/systemds/scuro/representations/image_bind.py
src/main/python/systemds/scuro/representations/resnet.py 		2
100 src/main/python/systemds/scuro/representations/image_bind.py
src/main/python/systemds/scuro/representations/word2vec.py 		1
100 src/main/python/systemds/scuro/representations/image_bind.py
src/main/python/systemds/scuro/representations/swin_video_transformer.py 		2
100 src/main/python/systemds/scuro/representations/image_bind.py
src/main/python/systemds/scuro/representations/wav2vec.py 		2
100 src/main/python/systemds/scuro/representations/image_bind.py
src/main/python/systemds/scuro/representations/x3d.py 		2
100 src/main/python/systemds/scuro/representations/image_bind.py
src/main/python/systemds/scuro/representations/clip.py 		2
100 src/main/python/systemds/scuro/representations/image_bind.py
src/main/python/systemds/scuro/representations/vgg.py 		2
100 src/main/python/systemds/scuro/representations/multimodal_attention_fusion.py
src/main/python/systemds/scuro/representations/lstm.py 		1
100 src/main/python/systemds/scuro/representations/multimodal_attention_fusion.py
src/main/python/systemds/scuro/representations/wav2vec.py 		1
100 src/main/python/systemds/scuro/representations/multimodal_attention_fusion.py
src/main/python/systemds/scuro/representations/mlp_averaging.py 		1
100 src/main/python/systemds/scuro/representations/clip.py
src/main/python/systemds/scuro/representations/bert.py 		2
100 src/main/python/systemds/scuro/representations/vgg.py
src/main/python/systemds/scuro/representations/bert.py 		2
100 src/main/python/systemds/scuro/representations/vgg.py
src/main/python/systemds/scuro/representations/resnet.py 		2
100 src/main/python/systemds/scuro/representations/vgg.py
src/main/python/systemds/scuro/representations/swin_video_transformer.py 		2
100 src/main/python/systemds/scuro/representations/vgg.py
src/main/python/systemds/scuro/representations/x3d.py 		2
100 src/main/python/systemds/scuro/representations/vgg.py
src/main/python/systemds/scuro/representations/clip.py 		2
100 src/main/python/systemds/scuro/representations/vgg.py
src/main/python/systemds/scuro/representations/color_histogram.py 		1
100 src/main/python/systemds/scuro/representations/lstm.py
src/main/python/systemds/scuro/representations/resnet.py 		1
100 src/main/python/systemds/scuro/representations/glove.py
src/main/python/systemds/scuro/representations/bert.py 		1
100 src/main/python/systemds/scuro/representations/glove.py
src/main/python/systemds/scuro/representations/word2vec.py 		1
100 src/main/python/systemds/scuro/drsearch/operator_registry.py
src/main/python/systemds/scuro/drsearch/hyperparameter_tuner.py 		1
100 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/bert.py 		2
100 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/resnet.py 		2
100 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/wav2vec.py 		2
100 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/x3d.py 		2
100 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/clip.py 		2
100 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/vgg.py 		2
100 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/bert.py 		2
100 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/resnet.py 		2
100 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/swin_video_transformer.py 		2
100 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/x3d.py 		2
100 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/resnet.py 		2
100 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/swin_video_transformer.py 		2
100 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/wav2vec.py 		2
100 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/vgg.py 		2
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/mlp_averaging.py 		1
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/clip.py 		1
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/vgg.py 		1
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/color_histogram.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/bert.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/resnet.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/word2vec.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/swin_video_transformer.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/wav2vec.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/x3d.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/image_bind.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/clip.py 		1
100 src/main/python/systemds/scuro/representations/openface.py
src/main/python/systemds/scuro/representations/vgg.py 		1
100 src/main/python/systemds/scuro/drsearch/process_cache.py
src/main/python/systemds/scuro/drsearch/hyperparameter_tuner.py 		2
100 src/main/python/systemds/scuro/drsearch/process_cache.py
src/main/python/systemds/scuro/drsearch/representation_dag.py 		2
100 src/main/python/tests/scuro/test_hpo_cache.py
src/main/python/systemds/scuro/representations/bert.py 		2
100 src/main/python/tests/scuro/test_hpo_cache.py
src/main/python/systemds/scuro/representations/resnet.py 		2
100 src/main/python/tests/scuro/test_hpo_cache.py
src/main/python/systemds/scuro/representations/swin_video_transformer.py 		2
100 src/main/python/tests/scuro/test_hpo_cache.py
src/main/python/systemds/scuro/representations/wav2vec.py 		2
100 src/main/python/tests/scuro/test_hpo_cache.py
src/main/python/systemds/scuro/representations/x3d.py 		2
100 src/main/python/tests/scuro/test_hpo_cache.py
src/main/python/systemds/scuro/representations/image_bind.py 		2
100 src/main/python/tests/scuro/test_hpo_cache.py
src/main/python/systemds/scuro/representations/clip.py 		2
100 src/main/python/tests/scuro/test_hpo_cache.py
src/main/python/systemds/scuro/representations/vgg.py 		2
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/x3d.py 		1
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/wav2vec.py 		1
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/swin_video_transformer.py 		1
100 src/main/python/systemds/scuro/representations/color_histogram.py
src/main/python/systemds/scuro/representations/bert.py 		1
100 src/main/python/systemds/scuro/representations/color_histogram.py
src/main/python/systemds/scuro/representations/resnet.py 		1
100 src/main/python/systemds/scuro/representations/color_histogram.py
src/main/python/systemds/scuro/representations/swin_video_transformer.py 		1
100 src/main/python/systemds/scuro/representations/color_histogram.py
src/main/python/systemds/scuro/representations/x3d.py 		1
100 src/main/python/systemds/scuro/representations/color_histogram.py
src/main/python/systemds/scuro/representations/clip.py 		1
100 src/main/python/systemds/scuro/representations/color_histogram.py
src/main/python/systemds/scuro/representations/vgg.py 		1
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/lstm.py 		1
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/resnet.py 		1
100 src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py
src/main/python/systemds/scuro/representations/bert.py 		1
90 src/main/python/systemds/scuro/representations/lstm.py
src/main/python/systemds/scuro/representations/bert.py 		1
88 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/clip.py 		2
88 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/bert.py 		2
88 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/word2vec.py 		1
88 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/word2vec.py 		1
88 src/main/python/systemds/scuro/representations/word2vec.py
src/main/python/systemds/scuro/representations/bert.py 		1
88 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/clip.py 		2
88 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/image_bind.py 		2
87 src/main/python/systemds/scuro/representations/vgg.py
src/main/python/systemds/scuro/representations/image_bind.py 		2
87 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/color_histogram.py 		1
87 src/main/python/systemds/scuro/representations/vgg.py
src/main/python/systemds/scuro/representations/wav2vec.py 		2
87 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/word2vec.py 		1
85 src/main/python/systemds/scuro/representations/color_histogram.py
src/main/python/systemds/scuro/representations/mlp_averaging.py 		1
83 src/main/python/systemds/scuro/representations/glove.py
src/main/python/systemds/scuro/representations/resnet.py 		1
78 src/main/python/systemds/scuro/representations/clip.py
src/main/python/systemds/scuro/representations/resnet.py 		2
78 src/main/python/systemds/scuro/representations/clip.py
src/main/python/systemds/scuro/representations/vgg.py 		2
77 src/main/python/systemds/scuro/representations/x3d.py
src/main/python/systemds/scuro/representations/color_histogram.py 		1
77 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/glove.py 		1
77 src/main/python/systemds/scuro/representations/wav2vec.py
src/main/python/systemds/scuro/representations/vgg.py 		2
75 src/main/python/systemds/scuro/representations/swin_video_transformer.py
src/main/python/systemds/scuro/representations/image_bind.py 		2
75 src/main/python/tests/scuro/test_hp_tuner.py
src/main/python/systemds/scuro/drsearch/hyperparameter_tuner.py 		1
75 src/main/python/systemds/scuro/representations/resnet.py
src/main/python/systemds/scuro/representations/bert.py 		2
75 src/main/python/tests/scuro/test_hp_tuner.py
src/main/python/systemds/scuro/representations/bert.py 		1
74 src/main/python/systemds/scuro/representations/bert.py
src/main/python/systemds/scuro/representations/word2vec.py 		1
73 src/main/python/systemds/scuro/representations/word2vec.py
src/main/python/systemds/scuro/representations/glove.py 		1
72 src/main/python/systemds/scuro/representations/mlp_averaging.py
src/main/python/systemds/scuro/representations/bert.py 		1
72 src/main/python/systemds/scuro/representations/mlp_averaging.py
src/main/python/systemds/scuro/representations/clip.py 		1
71 src/main/python/systemds/scuro/drsearch/operator_registry.py
src/main/python/systemds/scuro/representations/resnet.py 		1
71 src/main/python/systemds/scuro/drsearch/operator_registry.py
src/main/python/systemds/scuro/representations/bert.py 		1
71 src/main/python/systemds/scuro/representations/clip.py
src/main/python/systemds/scuro/representations/glove.py 		1
71 src/main/python/systemds/scuro/representations/bert.py
src/main/python/systemds/scuro/representations/resnet.py 		2

Biggest files changes in pull request

Estimated line counts are shown. Values may change once change summary has finished building.

Path View whole file Lines removed Lines added Final line count
src/main/python/systemds/scuro/drsearch/process_cache.py BeforeAfter 1 255 ---
src/main/python/systemds/scuro/drsearch/representation_dag.py BeforeAfter 41 33 ---
src/main/python/systemds/scuro/drsearch/hyperparameter_tuner.py BeforeAfter 12 15 ---
src/main/python/systemds/scuro/representations/openface.py BeforeAfter 0 4 ---
src/main/python/systemds/scuro/representations/glove.py BeforeAfter 0 4 ---
src/main/python/systemds/scuro/representations/word2vec.py BeforeAfter 0 4 ---
src/main/python/systemds/scuro/representations/x3d.py BeforeAfter 0 6 ---
src/main/python/systemds/scuro/representations/resnet.py BeforeAfter 0 4 ---
src/main/python/tests/scuro/test_hpo_cache.py BeforeAfter 0 151 ---
src/main/python/systemds/scuro/representations/mlp_learned_dim_reduction.py BeforeAfter 0 0 ---
src/main/python/systemds/scuro/representations/mlp_averaging.py BeforeAfter 0 0 ---
src/main/python/systemds/scuro/representations/vgg.py BeforeAfter 0 4 ---
src/main/python/systemds/scuro/representations/lstm.py BeforeAfter 0 0 ---
src/main/python/systemds/scuro/representations/color_histogram.py BeforeAfter 0 0 ---
src/main/python/tests/scuro/test_hp_tuner.py BeforeAfter 3 1 ---
src/main/python/systemds/scuro/representations/image_bind.py BeforeAfter 0 8 ---
src/main/python/systemds/scuro/representations/clip.py BeforeAfter 1 5 ---
src/main/python/systemds/scuro/representations/bert.py BeforeAfter 0 5 ---
src/main/python/systemds/scuro/representations/swin_video_transformer.py BeforeAfter 0 4 ---
src/main/python/systemds/scuro/representations/wav2vec.py BeforeAfter 0 5 ---
src/main/python/systemds/scuro/drsearch/operator_registry.py BeforeAfter 0 42 ---
src/main/python/systemds/scuro/representations/multimodal_attention_fusion.py BeforeAfter 0 0 ---

️ Biggest functions grown or shrunk by pull request

Which functions had their line count change as part of this pull request?

Estimated line counts are shown. Values may change once change summary has finished building.

Qualified function name View whole function Lines removed Lines added Final line count
TestHPTuner::run_hp_for_modality BeforeAfter 2 2 79
GitClear uses cookies to ensure you get the best experience on our website. Learn more about our cookie policy