1
0
mirror of https://github.com/pbnjay/grate.git synced 2025-03-04 16:16:03 +02:00

16 Commits

Author SHA1 Message Date
Jeremy Jay
460301037b off-by-one errors on both side of last refactor 2021-02-23 08:19:15 -05:00
Jeremy Jay
88aeec74f8 broken WIP tests and public testdata 2021-02-22 01:47:39 -05:00
Jeremy Jay
35c8ec73bc refactor sheets and formatting so we can use for type detection 2021-02-21 23:29:48 -05:00
Jeremy Jay
167574603f fix some XFs when applyNumberFormat not defined 2021-02-18 16:57:27 -05:00
Jeremy Jay
a10b07819d more bounds checking 2021-02-14 22:46:51 -05:00
Jeremy Jay
ad8345b944 fix some oob errors 2021-02-14 14:53:44 -05:00
Jeremy Jay
d9793eb9dd reuse memory as often as we can. update tests 2021-02-13 23:36:42 -05:00
Jeremy Jay
a5be267bf7 more tweaks to memory usage in xls this time
did not reduce total allocations much (bytes.Reader is more efficient
than I thought), but reduced walltime from 99s to 55s for a large collection
2021-02-13 00:06:04 -05:00
Jeremy Jay
b953163a8d tweaks to reduce memory usage in xlsx
on a test dataset, usage goes from 6.0GB => 3.3GB
and walltime improves from 31.6s => 19.4s

largest remaining driver is the slow/hungry xml.Decoder
2021-02-12 13:44:46 -05:00
Jeremy Jay
e244917a51 standardize and simplify debugging statements 2021-02-12 10:50:33 -05:00
Jeremy Jay
bbe0d2dbb4 don't load all sheets at once in xlsx 2021-02-12 10:48:57 -05:00
Jeremy Jay
26e4b46e83 more consistent error handling 2021-02-12 10:44:23 -05:00
Jeremy Jay
749e19458a allow openers to have a priority 2021-02-12 00:59:01 -05:00
Jeremy Jay
88daa500dc accidently implemented xlsx. refactor to include it 2021-02-12 00:50:50 -05:00
Jeremy Jay
b048fa8aad refactor common excel stuff 2021-02-11 01:28:46 -05:00
Jeremy Jay
8812c44704 why not? initial implementation of xlsx 2021-02-11 01:16:02 -05:00