Skip to content

Making task log storage optional for Kubernetes Runner#18341

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kfaraz merged 31 commits into from
Aug 11, 2025
Merged

Making task log storage optional for Kubernetes Runner #18341

Changes from 1 commit
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
6fa6d1a
WIP: K8s config
uds5501 Jul 29, 2025
11c3f8e
Using fileTaskLogConfigs for storing task logs
uds5501 Jul 30, 2025
01dee63
Revert "Using fileTaskLogConfigs for storing task logs"
uds5501 Jul 30, 2025
45f1fda
Revert "WIP: K8s config"
uds5501 Jul 30, 2025
d34e193
WIP: Use delegation based task streamer
uds5501 Jul 30, 2025
12fa583
WIP: provide module bindings in k8s overlord module for delegate cons…
uds5501 Jul 30, 2025
99082a8
WIP: Enable multi level stream switching
uds5501 Jul 31, 2025
f6e225f
Complete switching log implementation
uds5501 Aug 1, 2025
61bf9dc
WIP: remove the embedded k8s test for now
uds5501 Aug 1, 2025
d8d22ae
Add StreamingTaskLogs to CLII
uds5501 Aug 1, 2025
493cf96
Add configuration error message for noop use case.
uds5501 Aug 1, 2025
04f9784
stream task status correctly
uds5501 Aug 4, 2025
aba0d14
Bind all extensions and refactor task log pushes
uds5501 Aug 4, 2025
a6a375c
make static checks happy
uds5501 Aug 4, 2025
297a713
add more tests
uds5501 Aug 4, 2025
ec7d715
Complete tests for indexing service task logs modules
uds5501 Aug 4, 2025
c1b788c
Complete addition of missing tests
uds5501 Aug 4, 2025
1784cec
Address review comments
uds5501 Aug 8, 2025
c30d8d3
make maven check happy
uds5501 Aug 8, 2025
e2e64cf
fix binder tests
uds5501 Aug 8, 2025
7002b47
Fix local module tests
uds5501 Aug 8, 2025
0d339e8
Remove check for log saves
uds5501 Aug 8, 2025
87cc328
missed removal
uds5501 Aug 8, 2025
53b18fe
missed removal - 2
uds5501 Aug 8, 2025
88aa31f
re add configuration for k8s task runner
uds5501 Aug 8, 2025
680182d
Revert "re add configuration for k8s task runner"
uds5501 Aug 8, 2025
ba273de
add indexing module to bind task logs
uds5501 Aug 8, 2025
5f1043d
address review comments.
uds5501 Aug 9, 2025
86aad85
accommodate nitpicks
uds5501 Aug 11, 2025
999d9c7
Merge branch 'master' of github.com:apache/druid into stopping_log_pu…
uds5501 Aug 11, 2025
e9e01fb
fix docker script
uds5501 Aug 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
fix docker script
  • Loading branch information
@uds5501
uds5501 committed Aug 11, 2025
commit e9e01fb3593f86fbec32c5e421a62e9b1811b42f
6 changes: 4 additions & 2 deletions .github/scripts/run_docker-tests
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,5 +33,7 @@ else
echo "Running Docker tests with image[$DRUID_IMAGE_NAME]"
fi

OPTS+="-pl embedded-tests"
mvn -B $OPTS verify -Pdocker-tests -D$DRUID_IMAGE_SYS_PROPERTY=$DRUID_IMAGE_NAME "-DjfrProfilerArgLine=$JFR_PROFILER_ARG_LINE" "$@"
# No snapshot updates
OPTS+=" -nsu"
OPTS+=" -pl !integration-tests,!:druid-it-image,!:druid-it-cases"
mvn -B $OPTS verify -Pdocker-tests,skip-static-checks -DskipUTs -D$DRUID_IMAGE_SYS_PROPERTY=$DRUID_IMAGE_NAME "-DjfrProfilerArgLine=$JFR_PROFILER_ARG_LINE" "$@"
Loading