API Reference#
This page lists an overview of all public PySpark modules, classes, functions and methods.
Note
Spark SQL, Pandas API on Spark, Structured Streaming, and MLlib (DataFrame-based) support Spark Connect.
| CARVIEW |
Select Language
HTTP/2 200
server: Apache
last-modified: Fri, 23 May 2025 03:35:00 GMT
etag: "61f6b-635c548704d37-gzip"
content-encoding: gzip
access-control-allow-origin: *
content-security-policy: default-src 'self' data: blob: 'unsafe-inline' 'unsafe-eval' https://www.apachecon.com/ https://www.communityovercode.org/ https://*.apache.org/ https://apache.org/ https://*.scarf.sh/ https://*.algolia.net/ https://*.algolianet.com/ https://*.algolia.io/; script-src 'self' data: blob: 'unsafe-inline' 'unsafe-eval' https://www.apachecon.com/ https://www.communityovercode.org/ https://*.apache.org/ https://apache.org/ https://*.scarf.sh/ https://*.algolia.net/ https://*.algolianet.com/ https://*.algolia.io/; style-src 'self' data: blob: 'unsafe-inline' 'unsafe-eval' https://www.apachecon.com/ https://www.communityovercode.org/ https://*.apache.org/ https://apache.org/ https://*.scarf.sh/ https://*.algolia.net/ https://*.algolianet.com/ https://*.algolia.io/; frame-ancestors 'self'; frame-src 'self' data: blob: 'unsafe-inline' 'unsafe-eval' https://www.apachecon.com/ https://www.communityovercode.org/ https://*.apache.org/ https://apache.org/ https://*.scarf.sh/ https://*.algolia.net/ https://*.algolianet.com/ https://*.algolia.io/; worker-src 'self' data: blob:;
content-type: text/html
via: 1.1 varnish, 1.1 varnish
accept-ranges: bytes
age: 7549
date: Tue, 15 Jul 2025 15:50:15 GMT
x-served-by: cache-hel1410024-HEL, cache-bom4740-BOM
x-cache: HIT, HIT
x-cache-hits: 5, 0
x-timer: S1752594616.871601,VS0,VE2
vary: Accept-Encoding
strict-transport-security: max-age=31536000; includeSubDomains; preload
content-length: 29090
API Reference — PySpark 4.0.0 documentation
Skip to main content