CARVIEW |
Select Language
HTTP/2 200
date: Sun, 20 Jul 2025 10:14:04 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
x-robots-tag: none
etag: W/"21a071b538eae62d7cec86cc4c168c62"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=6itrL1GhbxWY7aS5WvF91tuxAtyUuXHxiK8bbQI3Pl%2B0OKr48vIt4r7qH4%2FescFt9QjVqFQd8oL%2FvhFs3Qo2gvG%2FqJd0G%2ByZt4%2ByJrYRJslIMMSnZDibzFB5QoWSV6xYoHkOxF41siZAd%2BkrCr07uPBQ8NP1UgGxIaS2DnIdPdIml1xQKPifgSg3g4cIJXS%2FNx3F%2F06T9y808UyTMUT7%2BIb0g%2BSXFS4TvBZMg%2BP0y2Tv7nKYtz6gVY95oJIMfJy7JiLYBm9P%2BPduPCazHXbVSA%3D%3D--zDyhf%2FQVX%2BZ8yYuF--e374Vf86WWOVwtOh8zYUbA%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.1088410288.1753006444; Path=/; Domain=github.com; Expires=Mon, 20 Jul 2026 10:14:04 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Mon, 20 Jul 2026 10:14:04 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: B8C6:67A53:CC32E9:10834D9:687CC16C
UDF · Kotlin/kotlin-spark-api Wiki · GitHub
Skip to content
Navigation Menu
{{ message }}
-
Notifications
You must be signed in to change notification settings - Fork 35
UDF
Jolan Rensen edited this page Jul 29, 2022
·
12 revisions
See the examples in code.
A(BCD)EF
:
-
A
(xor)-
udf
to just create a (vararg) UDF -
udaf
to just create a UDAF -
udafUnnamed
to create an unnamed UDAF (for whenudaf
fails to get a name from the Aggregator) -
udf.register
to immediately create and register a (vararg) UDF or UDAF. RequiresB
or requiresC
to be aNamedUserDefinedFunction
, anAggregator
, or a (vararg) UDF / UDAF function reference.
-
-
B
-
name
. AString
. Optional unless registering an unnamed (vararg) UDF or UDAF. Provides (new) name for the (vararg) UDF or UDAF.
-
-
C
(xor withE
)-
namedUdf
. ANamedUserDefinedFunction
(Vararg
), requiresA
to beudaf.register
(will provide name). -
udf
. AUserDefinedFunction
(Vararg
), requiresA
to beudaf.register
and requiresB
(will provide name). -
func
. A UDF- or UDAF function reference (will provide name based onfunc
). -
varargFunc
. A vararg UDF function reference. RequiresA
to be NOTudf
(will provide name based onvarargFunc
). -
agg
. AnAggregator
(can be created usingaggregatorOf()
) to create a UDAF. RequiresA
to be NOTudf
(will provide name based onagg
). -
zero
,reduce
,merge
,finish
, OptionalbufferEncoder
, OptionaloutputEncoder
. Creates UDAF in place instead of usingagg
(will provide name, "Aggregator" by default).
-
-
D
-
nondeterministic
. A Boolean. Optional, defaults tofalse
. Updates (vararg) UDF or UDAF to non-deterministic. For instance, for randomization.
-
-
E
(xor withC
)-
func
. An in-place UDF lambda (won't provide name, unless specified inB
orF
). -
varargFunc
. An in-place vararg UDF lambda (= takes a single array as parameter) (won't provide name, unless specified inB
orF
).
-
-
F
(Optional, or)-
.register()
. Will register the (vararg) UDF or UDAF. RequiresB
or requiresC
to be aNamedUserDefinedFunction
, anAggregator
, or a (vararg) UDF / UDAF function reference. -
.register(name: String)
. Will register the (vararg) UDF or UDAF with (new) name. -
.withName(name: String)
. Will give the (named) udf the (new) namename
.
-
Clone this wiki locally
You can’t perform that action at this time.