Skip to content

refactor: centralize Java dependency versions - #157

Merged
geruh merged 1 commit into
lance-format:mainfrom
hfutatzhanghb:agent/centralize-java-dependency-versions
Oct 10, 2026
Merged

geruh merged 1 commit into
lance-format:mainfrom
hfutatzhanghb:agent/centralize-java-dependency-versions

Conversation

@hfutatzhanghb

@hfutatzhanghb hfutatzhanghb commented Jul 13, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • centralize shared Java dependency and plugin versions in the root Maven properties
  • replace repeated Hive, Hadoop, Derby, Guava, JUnit, Mockito, AssertJ, and plugin version literals with property references
  • preserve module-specific one-off versions and the Glue-specific SLF4J override, and standardize the Hadoop property name
  • emit Unity Catalog column type_json values as complete StructField JSON with name, type, nullable, and metadata in both Java and Python
  • add Java and Python unit coverage for the table declaration payload, including Python Arrow schema conversion and escaped column names

Validation

  • git diff --check origin/main...HEAD
  • xmllint --noout java/pom.xml java/lance-namespace-hive2/pom.xml java/lance-namespace-hive3/pom.xml java/lance-namespace-iceberg/pom.xml java/lance-namespace-unity/pom.xml java/lance-namespace-glue/pom.xml
  • Python Unity unit tests: 19 passed
  • ruff check passed for the Python Unity implementation and tests
  • ruff format --check passed for the Python Unity implementation and tests
  • python3 -m py_compile python/src/lance_namespace_impls/unity.py python/tests/test_unity.py

Local Unity integration tests were not run because the Docker CLI is not executable in this environment. GitHub Actions is the integration validation gate for the updated commit.

@hfutatzhanghb
hfutatzhanghb force-pushed the agent/centralize-java-dependency-versions branch from 26410cd to 729246b Compare July 13, 2026 06:14
@hfutatzhanghb hfutatzhanghb changed the title build: centralize Java dependency versions refactor: centralize Java dependency versions Jul 13, 2026
@hfutatzhanghb
hfutatzhanghb force-pushed the agent/centralize-java-dependency-versions branch from d11881e to 571c07d Compare July 13, 2026 06:29
@hfutatzhanghb
hfutatzhanghb force-pushed the agent/centralize-java-dependency-versions branch 2 times, most recently from 14f0f8a to 1a1ea3f Compare October 8, 2026 03:53
Centralize shared Java dependency and plugin versions in the root Maven properties, keep module-specific overrides, and align the Hadoop property name.

Emit Unity Catalog column type_json values as complete StructField JSON in both Java and Python, with unit coverage for each table declaration payload.
@hfutatzhanghb
hfutatzhanghb force-pushed the agent/centralize-java-dependency-versions branch from 1a1ea3f to 4b06ffc Compare October 8, 2026 06:05
@github-actions github-actions Bot added the python label Oct 8, 2026
@hfutatzhanghb

Copy link
Copy Markdown
Contributor Author

Hi, @geruh . Could you please help review this PR when have free time? Thanks very much!

unity_type = self._convert_arrow_type_to_unity_type(arrow_field.type)
unity_type_json = self._convert_arrow_type_to_unity_type_json(
arrow_field.type
unity_type_json = self._create_unity_type_json(

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we are including a fix for unity payloads too? This is fine by me just calling it out

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@geruh Yes, this needs to be included in this PR — otherwise the CI build will fail. Thanks for flagging it!

@geruh geruh left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thanks for the cleanup @hfutatzhanghb!

@geruh
geruh merged commit f815e62 into lance-format:main Oct 10, 2026
23 of 25 checks passed
@hfutatzhanghb

Copy link
Copy Markdown
Contributor Author

@geruh Sir, Thanks very much for your reivewing and merging!!!

@hfutatzhanghb
hfutatzhanghb deleted the agent/centralize-java-dependency-versions branch October 12, 2026 01:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants