What's Changed

• add '|' as a delimiter in csv files by @jiajun-unstructured in #4059
• feat: map tags by type + add coverage by @MaksOpp in #4068
• chore: switch to charset normalizer by @qued in #4060
• bump version and release by @MaksOpp in #4070

Full Changelog: 0.18.10...0.18.11

0.18.10

Enhancements

Features

• Add OCR_AGENT_CACHE_SIZE environment variable Added configurable cache size for OCR agents to control memory usage.

0.18.9

Enhancements

Features

• Convert elements to markdown for output Added function to convert elements to markdown format for easy viewing.

Fixes

• Language detection nit Handle empty text
• Properly handle password protected xlsx - detect password protection on XLSX files and raise appropriate

0.18.7

Enhancements

Features

• Add language detection for PDFs Add document and element level language detection to PDFs.

Fixes

0.18.6

Enhancements

Features

Fixes

• Improved epub partition errors EPUB partition will now produce new type of error on unprocessable files.
• Fix type for serialized TableChunks Use TableChunk for the string value of the field type when serializing elements of type TableChunk, rather than using the value Table.

What's Changed

• fix(partition, csv): increase csv field limit by @ds-filipknefel in #4046

Full Changelog: 0.18.3...0.18.4

What's Changed

• chore: bump pillow to address a CVE by @awalker4 in #4045

Full Changelog: 0.18.2...0.18.3

What's Changed

• fix [NEX-49] : Fix TypeError for empty HTML content by @yuming-long in #4032
• fix: add try/except wrap over row.cells to failproof tc grid_offset by @Klaijan in #4033
• fix: xml processing not escaped by @jiajun-unstructured in #4034
• fix: update md to reads umlauts on non-utf-8 files by @Klaijan in #4037
• bump version by @Klaijan in #4038
• fix: fix header and footer not parsed as Header/Footer types by @badGarnet in #4041
• bump version to make a release by @badGarnet in #4042

Full Changelog: 0.18.1...0.18.2

Enhancements

Features

• Add DocumentData element type This is helpful in scenarios where there is large data that does not make sense to represent across each element in the document.

Fixes

• The encoding property of the _CsvPartitioningContext is now properly used.

What's Changed

• Matches prefix to verify presence of DOCX,PPTX,XLSX files instead of standard file names by @srisudarsan in #3959
• manual trigger of workflows to publish new image and new vers tag in … by @luke-kucing in #3965
• chore: deprecate stage_for_label_studio by @qued in #3968
• build: remove test and dev deps from docker image by @qued in #3969
• feat: convenience unstructured-get-json.sh update by @cragwolfe in #3971
• chore: allow changing default output dir for unstructured-get-json.sh by @cragwolfe in #3973
• chore: add html path to ingest-test-fixtures-update-pr by @cragwolfe in #3977
• fix: hi_res PDF parsing: only uncategorized text for extracted elements by @cragwolfe in #3975
• Fix sort_page_element. ensures that sorting is stable and not random. by @pprados in #3978
• Update pdfminer_utils.py by @Nathan-GoSupply in #3974
• fix cve by @potter-potter in #3989
• fix: Add missing diffstat command to test_json_to_html CI job by @mpolomdeepsense in #3992
• fix: failing build by @mpolomdeepsense in #3993
• fix: properly handle the case when an element's text is None by @badGarnet in #3995
• fix: Fix for Pillow error when extracting PNG images by @awalker4 in #3998
• fix: throw validation error when json is passed with invalid unstructured json by @jordan-homan in #4002
• Replace Serverless API to Platform announcement on README page by @ron-unstructured in #4003
• fix: resolve warnings of logger library by @emmanuel-ferdman in #3999
• chore: script to verify unstructured image outbound connectivity by @cragwolfe in #4008
• resolve CVEs and HF issue by @luke-kucing in #4009
• Feat/bump inference by @badGarnet in #4013
• Bump requests to address CVEs by @PastelStorm in #4015
• Drop Python 3.9 support due to dependency conflicts by @PastelStorm in #4017
• Remove IDs from HTML code by @plutasnyy in #4012
• fix chucking text None type has no attribute stripe by @yuming-long in #4018
• recompile on arm64 to get minimum reqs by @badGarnet in #4020

New Contributors

• @srisudarsan made their first contribution in #3959
• @Nathan-GoSupply made their first contribution in #3974
• @jordan-homan made their first contribution in #4002
• @emmanuel-ferdman made their first contribution in #3999
• @PastelStorm made their first contribution in #4015

Full Changelog: 0.17.2...0.17.11-dev1