Commit graph

303 commits

Author SHA1 Message Date
sslivkoff
f046c18c86 add better python annotations 2024-05-23 00:30:18 +00:00
sslivkoff
aa4674dac1 fix clippy warning 2024-05-13 16:10:20 -07:00
sslivkoff
c0bf55ab52
add r s v columns to txs (#191) 2024-05-13 15:06:59 -07:00
Yadomin
24fc2f772d
Add erc20_approvals dataset (#185) 2024-04-19 10:42:04 -07:00
caentzminger
3809965899
Added six columns to blocks (#179)
* Added columns to blocks

* update blocks schema length in tests
2024-02-03 14:08:35 -08:00
sslivkoff
34b17eb9d6 fix block range rounding edge cases 2024-01-25 13:32:33 -08:00
sslivkoff
0a36dace52 make partial collections of multi datasets idempotent 2024-01-21 21:47:56 -08:00
sslivkoff
21503ed02c allow collecting partial subsets of state read datasets 2024-01-21 21:30:21 -08:00
sslivkoff
3ea8032009 add logs n_data_bytes column 2024-01-20 20:11:59 -08:00
sslivkoff
152a635b42
fix crate versioning (#176) 2024-01-14 17:55:22 -08:00
sslivkoff
b5a1df8162
use none for eth calls reverts (#174) 2024-01-13 00:09:20 -08:00
sslivkoff
e6f6e5227e
add contract length columns (#172) 2024-01-10 21:37:13 -08:00
sslivkoff
816abfe445
Add n rlp bytes column (#171)
* add input length columns to txs

* add n_rlp_bytes column to txs dataset
2024-01-10 20:53:17 -08:00
sslivkoff
fef78eceee
add input length columns to txs (#170) 2024-01-10 20:37:30 -08:00
sslivkoff
da6ce5e9b1
Python updates (#168)
* add __version__ to python

* update cryo_python to cryo
2024-01-08 12:19:30 -08:00
sslivkoff
5a1a3bff49
add MESC (#165)
* add MESC

* fix timestamp tests
2024-01-02 18:58:02 -08:00
sslivkoff
c5ed90175b
add total rows to output (#164)
* add total rows to output

* format
2024-01-02 18:50:53 -08:00
sslivkoff
806d7fcbed
Add ipc support (#162)
* support multiple provider types

* add websocket support

* add ipc support
2023-12-31 12:18:53 -08:00
sslivkoff
b2221f9dfb
support websocket ws:// and wss:// rpc providers (#161)
* support multiple provider types

* add websocket support
2023-12-31 01:14:03 -08:00
sslivkoff
c34e1a7337 specify readme in pyproject.toml 2023-12-29 20:55:32 -08:00
sslivkoff
fa070d4822 add description to pyproject.toml 2023-12-29 20:51:34 -08:00
sslivkoff
60da99dd90 add python-specific README 2023-12-29 20:06:31 -08:00
sslivkoff
24181bbaba
update parse url and timestamp tests (#157)
* update parse url and timestamp tests

* format
2023-12-27 11:50:20 -08:00
PhilippLgh
17d25d7eda
fix: parquet column parsing (#127)
* fix: parquet column parsing

* avoid use of unwrap()

---------

Co-authored-by: sslivkoff <stormslivkoff@gmail.com>
2023-12-26 16:23:16 -08:00
codeesura
ae8d152595
refactor: streamlining DimIsNone trait and optimizing parse_u256_types (#153)
* refactor: simplify dim_is_none implementation in args for DimIsNone trait

* fix clippy

* optimize parse_u256_types func in args with streamlined logc
2023-12-26 15:33:32 -08:00
sslivkoff
041f38b5c2
add block hash columns where possible (#146) 2023-12-05 17:29:35 -08:00
sslivkoff
4d1031980e
0.3.0 (#142)
* apply clippy linter suggestions

* update to 0.3.0

* add full to syn

* add description to cryo_to_df

* add cryo_python metadata
2023-12-01 07:23:02 -08:00
sslivkoff
8764f62f0d
improve usability as a library (#141) 2023-12-01 06:09:15 -08:00
Fahim Ahmed
c5e44905b3
feat: add timestamps parameter (#126)
* add incomplete --timestamp parameter

* create interface for timestamp_to_block function

* add get_latest_block_number() function

* Add timestamp_to_block_number() function

* Use Strings for timestamp

* change timestamp argument to Vec<String> part 2

* use reference, fix get_latest_block_number()

* add parse_timestamp() functions

* make some block processing functions public

* cargo fmt

* add docs

* add support for "every nth value" syntax

* implement parse_timestamp_range_to_block_number_range()

* remove unused array in timestamp_to_block_numbers()

* fix binary search in timestamp_to_block_number()

* cargo fmt

* initial test for timestamp_to_block_number()

* cargo fmt

* Add additional timestamp_to_block_number tests

* return lower block number if edge case

* cargo fmt

* Test before genesis block and after latest block

* update commenting

* Test latest timestamp to latest block number

* refactor timestamp test cases

* add rate limit to timestamp test setup

* remove unneeded test case

* update testing rpc

* cargo fmt

* remove redundant timestamp test

* reduce value in timestamp extrema test case

* Add tests for timestamp ending with a unit

* Fix timestamp range to blocknumber range and add tests

* Refactor parse timestamp functions and fix tests

* cargo fmt

* Refactor get_latest_block_number() into blocks.rs

* remove unneeded test case

* optimize latest timestamp testcase

* cargo fmt

* use parse_timestamps, and rename file

* update docs, use timestamps instead of timestamp

* fix typo in timestamp specification syntax

* update timestamp scaling units

* remove debug print

* update docs to incorporate timestamp scales

* update tests

* Remove test case that overloads RPC
2023-11-28 11:16:21 -08:00
sslivkoff
ebfc97b358
Skip noncompliant logs (#136)
* fix log datasets aliases and null calls

* skip noncompliant logs when decoding
2023-11-22 12:16:57 -06:00
sslivkoff
b41ffa517b
fix log datasets aliases and null calls (#134) 2023-11-20 21:17:56 -06:00
cool-mestorf
6e9ec88a35
filter erc transfers and traces by from/to addresses (#123)
* filter erc transfers and traces by from/to addresses

* review: move reward address to proper filter

* review: filter by rpc parameter

* fmt
2023-11-15 12:19:29 -08:00
Fahim Ahmed
fd8a752ee4
remove NumberChunk's numbers() function (#124) 2023-11-14 19:45:46 -08:00
sslivkoff
2b4e8b2bc2
remove raw data after decode (#122) 2023-11-13 20:06:07 -08:00
sslivkoff
9408ae02b0 add event__ prefix to decoded event columns 2023-11-13 19:38:50 -08:00
sslivkoff
f0966ee278
fix improper sort of decoded columns (#121) 2023-11-13 18:57:30 -08:00
sslivkoff
d577fef047
maintain order of decoded columns (#120)
* maintain order of decoded columns

* fix test
2023-11-13 18:13:38 -08:00
sslivkoff
0b04b4a867
fix event decoding to binary (#119) 2023-11-13 17:13:46 -08:00
sslivkoff
83c06ecc7f
fix hex encoding of empty event decoding (#118) 2023-11-13 16:44:54 -08:00
sslivkoff
15b570da5a
fix case where decoding an empty dataframe of events with u256 (#117) 2023-11-13 16:22:29 -08:00
sslivkoff
cd1f3a42e4
add suffix to datatype subdir (#116) 2023-11-13 12:16:56 -08:00
sslivkoff
0733f705e5
fix event decoding and add u256 / i256 support (#115) 2023-11-13 09:41:58 -08:00
Fahim Ahmed
27fc374b06
Fix typo in error handling comment (#114) 2023-11-12 23:13:14 -08:00
cool-mestorf
7da85e8f7a
add FromAddres dimension & take it from cli parameter, filter txs by from_address & to_address (#111)
* add FromAddress dimension and add corresponding implementations

* implement from_address & to_address filter for txs

* take from_address from cli params, filter tx and receipts by from & to address

* remove unnecessary vec definition

* fmt

* remove timestamp param

* review: fetch less receipts if transaction filter is applied
2023-11-12 13:57:54 -08:00
sslivkoff
2c803b6128
add --label argument (#112)
* add --label argument

* fix typo in docstring
2023-11-11 13:49:30 -08:00
sslivkoff
aa946d3c51
add noop result to fourbyte traces (#110) 2023-11-09 22:38:06 -08:00
Jiri Andras
6d5dd0d13e
Add block_timestamp, block_hash as optional columns to transactions (#109)
Co-authored-by: jiri.andras <jiri.andras@tatum.io>
2023-11-08 12:28:44 -08:00
sslivkoff
8f9b48458d
rename rust python dir (#107) 2023-11-07 23:47:33 -08:00
sslivkoff
8d956c9a32
allow erc20 metadata reverts (#105)
* allow erc20 metadata reverts

* formatting
2023-11-06 17:47:42 -08:00
sslivkoff
63dc679bd5 add storage dataset aliases 2023-11-05 20:43:36 -08:00