Reduce Smart Data Extraction package size

Requirements

These packages are required to use these features in production. Trial keys have unlimited access to all features

Package: Smart Data ExtractionModule: Data Extraction

The Smart Data Extraction module uses artificial intelligence in several of its engines, and as a result, can consume a substantial amount of disk space. This can be limiting for some users who need to work in constrained environments with limited storage, such as certain cloud computing environments.

The Data Extraction module is composed of four engines, each with its own file requirements. If you need only a subset of these engines, you can remove files from the package that aren't dependencies of your required engine. Each engine's file dependencies are platform-specific.

The following table provides Linux and Windows file dependencies for each extraction engine and shows which files you can remove when you don't use specific features.

Linux

The table below maps each engine to its file dependencies.

Engine Name	Dependencies
Tabular Data Extraction	Lib/Linux/TabluarData/* Lib/Linux/OCRModule
Document Structure Recognition	Lib/Linux/StructuredOutput Lib/Linux/fonts2.pdf Lib/Linux/tessdata/* The following files are only required if using Deep Learning Assist: Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor Lib/Linux/AIPageObjectExtractor/table.onnx Lib/Linux/AIPageObjectExtractor/table_tabular.onnx Lib/Linux/AIPageObjectExtractor/Licenses
Document Structure Recognition (Paddle OCR)	Lib/Linux/paddleocr/* Lib/Linux/onnx/*
Form Field Detection	Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor Lib/Linux/AIPageObjectExtractor/form.onnx Lib/Linux/AIPageObjectExtractor/Licenses
Form Field Key-Value Extraction	Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor Lib/Linux/AIPageObjectExtractor/form.onnx Lib/Linux/AIPageObjectExtractor/kv.onnx Lib/Linux/AIPageObjectExtractor/kv_v.cab Lib/Linux/AIPageObjectExtractor/Licenses
Generic Key-Value Extraction	Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor Lib/Linux/AIPageObjectExtractor/kv.onnx Lib/Linux/AIPageObjectExtractor/kv_v.cab Lib/Linux/AIPageObjectExtractor/Licenses
Document Classification	Lib/Linux/AIPageObjectExtractor/AIPageObjectExtractor Lib/Linux/AIPageObjectExtractor/class.onnx Lib/Linux/AIPageObjectExtractor/Licenses

If the engines you are using do not depend on a given file, you are free to remove that file. For example, if you are using the Form Field Key-Value Extraction engine and the Document Structure Recognition engine (without Deep Learning Assist), then you can remove any files that are only needed for the Tabular Data Extraction engine. In this example, you would be left with the following:

Lib
└── Linux
    ├── AIPageObjectExtractor
    │   ├── AIPageObjectExtractor
    │   ├── class.onnx
    │   ├── form.onnx
    │   ├── kv.onnx
    │   ├── kv_v.cab
    │   └── Licenses
    ├── fonts2.pdf
    ├── StructuredOutput
    └── tessdata
        ├── chi_sim.traineddata
        ├── chi_sim_vert.traineddata
        ├── chi_tra.traineddata
        ├── chi_tra_vert.traineddata
        ├── ell.traineddata
        ├── eng.traineddata
        ├── grc.traineddata
        ├── jpn.traineddata
        ├── jpn_vert.traineddata
        ├── kor.traineddata
        └── kor_vert.traineddata

Windows

The table below maps each engine to its file dependencies.

Engine Name	Dependencies
Tabular Data Extraction	Lib/Windows/TabluarData/* Lib/LiWindowsnux/OCRModule.exe
Document Structure Recognition	Lib/Windows/StructuredOutput.exe Lib/Windows/tessdata/* The following files are only required if using Deep Learning Assist: Lib/Windows/AIPageObjectExtractor/AIPageObjectExtractor.dll Lib/Windows/AIPageObjectExtractor/table.onnx Lib/Windows/AIPageObjectExtractor/table_tabular.onnx Lib/Windows/AIPageObjectExtractor/Licenses
Document Structure Recognition (Paddle OCR)	Lib/Windows/paddleocr/ Lib/Windows/onnx/
Form Field Detection	Lib/Windows/AIPageObjectExtractor/AIPageObjectExtractor.dll Lib/Windows/AIPageObjectExtractor/form.onnx Lib/Windows/AIPageObjectExtractor/Licenses
Form Field Key-Value Extraction	Lib/Windows/AIPageObjectExtractor/AIPageObjectExtractor.dll Lib/Windows/AIPageObjectExtractor/form.onnx Lib/Windows/AIPageObjectExtractor/kv.onnx Lib/Windows/AIPageObjectExtractor/kv_v.cab Lib/Windows/AIPageObjectExtractor/Licenses
Generic Key-Value Extraction	Lib/Windows/AIPageObjectExtractor/AIPageObjectExtractor.dll Lib/WindowsAIPageObjectExtractor/kv.onnx Lib/Windows/AIPageObjectExtractor/kv_v.cab Lib/WindowsAIPageObjectExtractor/Licenses
Document Classification	Lib/Windows/AIPageObjectExtractor/AIPageObjectExtractor.dll Lib/WindowsAIPageObjectExtractor/class.onnx Lib/WindowsAIPageObjectExtractor/Licenses

If the engines you are using do not depend on a given file, you are free to remove that file. For example, if you are using the Form Field Key-Value Extraction engine and the Document Structure Recognition engine (without Deep Learning Assist), then you can remove any files that are only needed for the Tabular Data Extraction engine. In this example, you would be left with the following:

Lib
└── Windows
    ├── AIPageObjectExtractor
    │   ├── AIPageObjectExtractor.dll
    │   ├── class.onnx
    │   ├── form.onnx
    │   ├── kv.onnx
    │   ├── kv_v.cab
    │   └── Licenses
    ├── StructuredOutput.exe
    └── tessdata
        ├── chi_sim.traineddata
        ├── chi_sim_vert.traineddata
        ├── chi_tra.traineddata
        ├── chi_tra_vert.traineddata
        ├── ell.traineddata
        ├── eng.traineddata
        ├── grc.traineddata
        ├── jpn.traineddata
        ├── jpn_vert.traineddata
        ├── kor.traineddata
        └── kor_vert.traineddata