Tag
#etl
49 repositories
Repos
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee
基于python和llm大模型开发的数据处理和任务调度系统。 支持数据源管理，数据模型管理，数据集成，数据查询API接口，低代码自定义数据处理任务模版，单任务及dag任务工作流调度等功能。集成了llm模块实现rag知识库问答，链接各数据源数据进行数据对话问答，交互式数据分析功能。
ETL for moving Ethereum data to PostgreSQL database
Decentralized, account-centric programmable indexing network for web3. Supports blockchain explorers, on-chain portfolios, social graphs, and ZK coprocessors. Open-source EVM-compatible indexer available.
The powerful analysis platform to explore and visualize data from blockchain.
ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub
Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes
When no one can tell the difference between art, and an empty canvas, the meaning is lost.
Ethereum Analytical Database - Ethereum data access solution that can be used for analytics and application development. The solution works on a fast DB - Clickhouse.
A python library to push ethereum blockchain data into an sql database.
Airflow DAGs for https://github.com/blockchain-etl/bitcoin-etl
A Python toolkit for extracting and transforming Bitcoin blockchain data into structured formats.
Python scripts for ETL (extract, transform and load) jobs for Klaytn blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions.
Datawaves data models for Ethereum built using dbt
A tool for streaming time series data from a BigQuery table to a Pub/Sub topic
👾 my old deep learning notebooks (e.g., tensorflow examples, caffee, deep art, numpy)
Python3 lib and cli for operating a Cardano Passive Node and using the API's. (PRE-ALPHA)
Airflow DAGs for ingesting Bitcoin blockchain data to Neo4j
A collection of SQL views used to enrich data produced by a Helium blockchain-etl
web3research-etl is a multichain-supported data ETL kit used on Web3Research Platform
WeaveVM Archiver is an ETL archive pipeline for EVM networks. It's the simplest way to interface with WeaveVM's permanent data feature without smart contract redeployments
Tools to analyze event log data of Ethereum and other EVM blockchains by Postgres, Amazon Redshift, DuckDb
an ultra-low-latency Ethereum indexer running as a Reth ExEx. streams EVM data to ClickHouse with 4ms latency and 71k+ tx/sec throughput.
ETL(Extract, Transform, Load) data from Ethereum like EVM Block chain
Kylinkit (i.e. Kylink kit) is a multi-chain data ETL tool used on Kylink Platform
🌌 CLI tool for extracting diverse data from Cosmos chain snapshots
Public ERC721/4907 "Rental" standard NFT smart contracts enabling (EWM) light-clients, whitelisted staking participants, nft allowances, nft delegation and DAS verification rewards for EVM chains.
Utility to archive logs emitted by smart contracts in Ethereum or other EVM blockchains into Postgres.
Data backfill extension for WeaveVM-ExEx data protocol on Arweave
Python scripts for extracting and transforming data to be used in Dotinsights' deep dive reports
Realtime Ethereum Blockchain events monitoring through contracts/topics subscriptions.