Type-safe CSV & Excel
ingestion for TypeScript.
Parse, validate, and process massive datasets through one headless pipeline. Bring your own UI, we handle the heavy lifting.
pnpm add @izanagi-labs/ingestxnpmSchema Validation
Define exactly what valid data looks like using the built-in, fully typed ix schema builder.
Streaming & Chunking
Process massive datasets without freezing the browser or treating everything as one giant result.
CSV + Excel
Use a single unified ingestion pipeline across common tabular formats (CSV, XLSX, XLS).
Lifecycle Control
Start, pause, resume, and cancel ingestion on the fly, with precise progress tracking.
Developer-first API
IngestX handles the ingestion pipeline so you don't have to repeatedly wire together parsing, validation, and result accumulation.
- Schema-first architecture
- Fully typed in TypeScript
- Headless implementation
- Lightweight footprint
import { ingest, ix } from "@izanagi-labs/ingestx";
// Define exactly what your data should look like
const columns = [
{
key: "email",
name: "Email Address",
matchHeader: (header) => header.toLowerCase().includes("email"),
schema: ix.string().regex(/@/),
}
];
const ingestion = ingest({
file,
columns,
onProgress: (progress) => {
console.log(\`Processing... ${(progress.percentage * 100).toFixed(0)}%\`);
}
});
// Pause and resume on demand
ingestion.pause();
ingestion.resume();
const { data, error } = await ingestion.result;
Built for Serious Workloads
IngestX is engineered to process massive datasets efficiently, bypassing typical browser memory limitations through chunked execution.
Chunked Processing
Files are processed in manageable chunks, ensuring the main thread remains unblocked and responsive during ingestion.
Memory Conscious
CSV ingestion scales incrementally, avoiding the need to load the entire dataset into memory at once.
Bounded Collection
Supports bounded result accumulation or external flushing, allowing you to process multi-gigabyte files securely.
Universal Runtime Support
Designed to run wherever your application does, with specialized adapters for optimal ergonomics.
Browser
Headless ingestion directly in browser applications using standard File objects.
React
Seamless integration via the useIngest hook, managing reactive lifecycle state automatically.
Node
File-path based ingestion for server-side workflows and background processing.