Commit graph

40 commits

Author SHA1 Message Date
e858ec83c9 fix(schema): allow paths without an explicit width
Make path width nullable to preserve absent WIDTH records separately from explicit zero or negative widths in full and selected reads.
2026-11-14 14:39:08 -08:00
ae33c4948b fix(parser): calculate array reference pitches without overflow
Use i64 coordinate differences and checked i32 pitches in both scans and full reads. Reject nonpositive counts, malformed coordinate records, and pitches that cannot fit the packed schema.
2026-11-14 14:39:01 -08:00
3783320f82 fix(writer): serialize complete records with correctly sized buffers
Include record headers in wire lengths, allocate initialized array and padded string buffers, and handle empty strings. Write all bytes to short writers and reject oversized records before writing.
2026-11-14 14:37:35 -08:00
aa2132dc6e fix(packing): validate unsigned and floating point inputs
Compare inputs against integer bounds in f64 so unsigned minima and rounded f32 maxima cannot bypass validation. Reject nonfinite floats and preserve packed bytes in native source slots.
2026-11-14 14:36:25 -08:00
9643089f2d feat(parser): add hierarchy scans and selective cell reads
Reuse library builders and cell traversal for full reads, lightweight hierarchy scans, and exact cell byte ranges. Preserve file offsets across readers and reject malformed ranges and FFI pointer/count inputs without aborting.

Document scan schemas and ID assignment. Add regression coverage for Arrow round trips, transforms, subset ordering, empty selections, and invalid input.
2026-11-14 14:27:09 -08:00
24438c4840 fix(ffi): return parser status and isolate thread errors 2026-11-14 14:23:13 -08:00
740cf9c693 fix(records): correct BGNSTR timestamp payload size 2026-11-14 14:21:39 -08:00
7ddfc0cd7f some docs 2026-04-02 20:41:16 -07:00
365b45cfe0 drop old iface.rs 2026-04-02 20:37:12 -07:00
d3bf15f47a follow masque interface 2026-04-02 20:35:31 -07:00
22040d9432 performance work 2026-04-02 20:22:15 -07:00
572b39aca0 enable lto 2025-04-22 20:17:23 -07:00
029662d887 cleanup 2025-04-22 20:17:17 -07:00
78d1d6e7de lump together x and y, and counts 2025-04-22 20:16:38 -07:00
9dbfb5e4ec style 2025-04-22 20:14:59 -07:00
55761d2e54 propvalue might be any size 2025-04-22 20:14:51 -07:00
259df49a22 use global dictionary approach for layers
maybe there's a way to do this with arrow dictionaries?
2025-04-20 23:21:54 -07:00
jan
9c98ee2b97 return masque-style (dx, dy) vectors for AREF 2025-04-12 23:02:08 -07:00
jan
1b3a6a45ce minor cleanup 2025-04-12 12:51:26 -07:00
jan
e2ba1390c6 first working attempt 2025-04-12 12:06:36 -07:00
jan
4aa14c4914 various cleanup and add some example interfaces 2025-04-11 11:18:56 -07:00
jan
4a7bc8090a arrow attempt compiles, nothing tested yet 2025-04-10 01:07:11 -07:00
jan
ec659b559d fixes for cffi approach 2024-12-21 16:38:56 -08:00
jan
bac31e2ce6 CFFI + maturin approach 2024-12-21 15:42:50 -08:00
jan
320958d888 ctypes approach 2024-12-21 13:56:51 -08:00
jan
ba07d253d2 pyo3 variant working 2024-12-21 09:50:19 -08:00
jan
ad1c2f1c35 remove commented code 2024-12-19 19:02:55 -08:00
jan
e42ac03c95 add FloatTooBigError 2024-12-18 17:27:10 -08:00
jan
babd7f1402 test for panic if float is too large for real8 2024-12-18 16:51:42 -08:00
jan
a1e9a3f90c fix incomplete condition 2024-12-18 16:44:05 -08:00
jan
b049f70dce check_size should be public 2024-12-18 16:43:50 -08:00
jan
6186f1d561 enable more tests 2024-12-18 16:43:41 -08:00
jan
6531bec6e5 ErrType should be Debug 2024-12-17 18:39:02 -08:00
jan
24d8e32173 add leading zeros to mask 2024-12-17 18:38:50 -08:00
jan
e5e0adab71 fixup imports/exports 2024-12-17 18:38:40 -08:00
jan
921afa5569 whitespace 2022-05-20 19:44:17 -07:00
jan
02e483c8cd update to 2021 edition 2022-05-08 16:41:43 -07:00
jan
07100dee8e WIP on (no branch): 48db472 snapshot 2021-12-18 21:05:00.635887 2022-03-20 16:28:34 -07:00
jan
00a29941b7 index on (no branch): 48db472 snapshot 2021-12-18 21:05:00.635887 2022-03-20 16:28:34 -07:00
48db47217a snapshot 2021-12-18 21:05:00.635887 2021-12-18 21:05:00 -08:00