Repository navigation

feat: custom Rust UDFs [experimental] [skip ci] - #4283

Closed

andygrove wants to merge 31 commits into

apache:mainfrom

andygrove:feat/rust-udfs

Closed

feat: custom Rust UDFs [experimental] [skip ci]#4283
andygrove wants to merge 31 commits into
apache:mainfrom
andygrove:feat/rust-udfs

Commits on May 10, 2026
- feat(udf-sdk): add comet-udf-sdk crate skeleton
  andygrove
  committed
  9f51ebc
- chore(udf-sdk): inherit workspace metadata and fix doc link
  andygrove
  committed
  05770a5
- feat(udf-sdk): add type tags and field IPC helpers
  andygrove
  committed
  c4a59fe
- chore(udf-sdk): re-export IPC helpers and tighten field round-trip test
  andygrove
  committed
  97b22e6
- feat(udf-sdk): add CometUdfError and #[repr(C)] UdfError
  andygrove
  committed
  e0d7669
- chore(udf-sdk): tighten UdfError ergonomics and pin layout
  andygrove
  committed
  275fc86
- feat(udf-sdk): add CometScalarUdf trait and UdfDescriptor
  andygrove
  committed
  fea30b5
- chore(udf-sdk): pin UdfDescriptor layout and tidy imports
  andygrove
  committed
  b345d61
- feat(udf-sdk): add export! macro and FFI invoke implementation
  andygrove
  committed
  54652a2
- chore(udf-sdk): add null guards and tighten export! macro docs
  andygrove
  committed
  4bfbc2d
- feat(udf-sdk): add optional DataFusion ScalarUDFImpl adapter
  andygrove
  committed
  51cf22d
- chore(udf-sdk): make adapter constructor fallible and cache config options
  andygrove
  committed
  d058ee8
- test(udf-sdk): add comet-test-udfs cdylib with AddOne
  andygrove
  committed
  88a6925
- docs(test-udfs): clarify intentional duplication with SDK fixture
  andygrove
  committed
  fa3ebf8
- test(udf-sdk): add struct/error/panic/length-mismatch test UDFs
  andygrove
  committed
  e824d82
- feat(rust-udf): add libloading dep and host module skeleton
  andygrove
  committed
  b4bec8c
- feat(rust-udf): add cdylib loader with ABI/symbol checks
  andygrove
  committed
  174003c
- chore(rust-udf): fix sdk dep placement and add SAFETY comments to loader
  andygrove
  committed
  5adb3e9
- feat(rust-udf): add process-wide library cache
  andygrove
  committed
  c8f3f66
- feat(rust-udf): add RustUdfAdapter impl ScalarUDFImpl
  andygrove
  committed
  797b026
- chore(rust-udf): cache invoke fn pointers and check return type
  andygrove
  committed
  acd738d
- feat(rust-udf): add RustUdfCall protobuf message
  andygrove
  committed
  62a948d
- feat(rust-udf): handle RustUdfCall in PhysicalPlanner
  andygrove
  committed
  894c507
- feat(rust-udf): add JNI bridge for driver-side library validation
  andygrove
  committed
  2da5056
- feat(rust-udf): add typed exception classes
  andygrove
  committed
  1900f48
- feat(rust-udf): add CometRustUdfRegistry
  andygrove
  committed
  a8f8eca
- feat(rust-udf): add CometRustUDF.register / registerAll
  andygrove
  committed
  4f18e39
- feat(rust-udf): emit RustUdfCall proto for registered names
  andygrove
  committed
  6a548ba
- test(rust-udf): add end-to-end CometRustUdfSuite
  andygrove
  committed
  6fbde43
- docs(rust-udf): add user guide for custom Rust UDFs
  andygrove
  committed
  f6d420b
- chore(rust-udf): apply review feedback
  andygrove
  committed
  548b7a5

Commits

Commits on May 10, 2026