sync with open source how#118
Draft
lesterhaynes wants to merge 8481 commits intolinkedin:li_trunkfrom
Draft
Conversation
njeevan233-spec
approved these changes
Feb 1, 2026
…eIO. (#37463) * Address circular dependencies. * Fix formatting. * Fix tests. * Fix lint. * Remove unused import. * Resolve circular dependency without removing __repr__. * Fix formatting. * Remove nextmark_json_util and move all its methods into nextmark_model. * Restore millis_to_timestamp. * Plumb custom batch params and add tests. * Fix formatting and imports. * Fix imports and test. * Add missing import. * Add another test case for byte count. * Added checks for positive values.
* Also fix stale bot closing pinned issue
* Fix flakes * Don't use the same tag twice
* Update RunInference to work with model manager * Fix lint * More lint * Add unittest main call * Update sdks/python/apache_beam/ml/inference/base.py Co-authored-by: Danny McCormick <dannymccormick@google.com> * Update sdks/python/apache_beam/ml/inference/base_test.py Co-authored-by: Danny McCormick <dannymccormick@google.com> * Add some comments explaining the model loading logistics * Update name in tests as well --------- Co-authored-by: Danny McCormick <dannymccormick@google.com>
* Draft of updated lock notify * Complete queue ticket implementation * Remove redudant warning log
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.34.0 to 0.35.0. - [Commits](golang/oauth2@v0.34.0...v0.35.0) --- updated-dependencies: - dependency-name: golang.org/x/oauth2 dependency-version: 0.35.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
changed boolean causedByDrain in WindowedValue interface to enum. spotless
…7467) * feat: Introduce agent skills for various Apache Beam development areas, including Java, Python, I/O connectors, and runners. * added headers * docs: Add license compliance skill documentation and update the skills README. * build: Exclude pytest cache files from the build configuration. * style: Remove trailing whitespace in skill documentation files. * docs: Update CI/CD skill documentation to reflect new workflow triggering methods and add a link to the main agent skills documentation.
* Exercise Flink PVR tests * Fix avro compat test dep
* alter catalog * alter table * spotless * spotless * fix unparse method, cleanup * add more tests * add deps * address comments: add java docs; add unit tests for unparsing; fix nits * spotless
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.78.0 to 1.79.3. - [Release notes](https://github.com/grpc/grpc-go/releases) - [Commits](grpc/grpc-go@v1.78.0...v1.79.3) --- updated-dependencies: - dependency-name: google.golang.org/grpc dependency-version: 1.79.3 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…l.py (#37857) Replace root logger calls (logging.info, logging.warning, etc.) with a module-level named logger (_LOGGER = logging.getLogger(__name__)) in apache_beam.transforms.util. This allows sdk_harness_log_level_overrides to properly control log levels for this module.
* Adds bundleFinalizer support to non-portable worker. * Removes check preventing stateful DoFn's with bundle finalizers from running on Dataflow streaming non-portable worker when using Streaming Engine
* Handle some cases during infer schema from dataclass * For backward compatibility, only infer schema for frozen dataclasses when it's registered with row coder * Make sure Beam schema ID does not inherit * Fix IndexOutofBoundError trying to infer type from custom Iterable without type hint * Fix #37862: fixed named tuple and effectively fails dataclass inside union typehint * Allow non-frozen dataclass register with other coders as a backup for backward compatibility; add tests * Add upgrade compatibility check for potential coder change * Update CHANGES.md Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * Test case for update_compatibility_version --------- Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
…#37758) * addressed all EqualsGetClass warnings * Fix GetterBasedSchemaProvider.equals * supress equalsGetClass in ProtoCoder and DynamicProtoCoder.
supress warnings in tests
…dBeConst check (#37771) * Fix Slf4j formatting errors in sdks/java/io/google-cloud-platform * enable Slf4jFormatShouldBeConst * Resolving Slf4jFormatShouldBeConst violations * revert log format due to usage in tests * remove duplicate check
…hrows checks (#37791) * enable JavaUtilDate, TimeUnitConversionChecker, InvalidThrows checks * fix outstanding JavaUtilDate and invalidThrows violations
* Update Go Version to 1.26.1 * update CHANGES.md * fix broken formatting directives
…#37861) * Fix #37736: Allow composite transforms to use implicit input chaining When a composite transform has no explicit inputs/outputs on its sub-transforms, automatically chain them similar to how 'chain' type transforms work. Added test_composite_implicit_input_chaining to verify the fix. * Fix line-too-long lint error in yaml_transform.py * Fix yapf formatting in yaml_transform.py * Fix composite implicit input chaining logic * Fix composite implicit input chaining - delete empty input from spec * Fix composite implicit input - reference pipeline input directly * Fix composite implicit input - reference pipeline input * Revert "Fix composite implicit input - reference pipeline input" This reverts commit ceb0ac1. * Fix composite implicit input chaining from pipeline input This fix addresses the issue where composite transforms with no explicit input specification were failing to receive inputs from the pipeline. Key changes: 1. Fixed has_explicit_io check to use is_empty() instead of just checking key presence - this properly treats {} as 'no explicit input' 2. Added composite_has_input check to only do implicit chaining when the composite has an input to chain from 3. Fixed inner_scope_inputs computation to use parent scope's inputs when the composite has no explicit input 4. Fixed output handling to use is_empty() check (normalization sets {}) 5. Fixed final return to correctly resolve scope inputs vs transform outputs * Apply yapf formatting and fix pylint line length issues * Address review: revert unnecessary variable assignment
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Please add a meaningful description for your change here
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, commentfixes #<ISSUE NUMBER>instead.CHANGES.mdwith noteworthy changes.See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.