**Proponent:** [Subsquid Lab Official](https://polkadot.subscan.io/account/13bfKSQXoBn3AMLtZaW6BKv797fqZzsD3PYF6xpJDir3tdoE) - 13bfKSQXoBn3AMLtZaW6BKv797fqZzsD3PYF6xpJDir3tdoE


**Beneficiary:** [Subsquid Lab Official](https://polkadot.subscan.io/account/13bfKSQXoBn3AMLtZaW6BKv797fqZzsD3PYF6xpJDir3tdoE) - 13bfKSQXoBn3AMLtZaW6BKv797fqZzsD3PYF6xpJDir3tdoE


**Contact Details:** Subsquid Labs GmbH, 6302 Zug, Switzerland - mf@subsquid.io


**Short description:** Ongoing development and maintenance costs for public Subsquid Archives and the Giant Squid API


**Archive raw data:** [Archive Infrastructure Metrics - January, February, March](https://docs.google.com/spreadsheets/d/e/2PACX-1vRW2UJeY6qR2RiCFfBZ70EZ3i45sc03kizxwgXrJdIqfkn6ygDkRDVNElXmzP3bK9ENB5weUyFM9pvP/pubhtml)

**Giant Squid raw data:** [Giant Squid Infrastructure Metrics - January, February, March](https://docs.google.com/spreadsheets/d/e/2PACX-1vRrG2wW7XXcsfgY-AGp-luHvhu5H-uQWd7xcli84celv42g9SctqA6JOMdZOYJCf_3hBvh3VFIf_GfG/pubhtml)

**Requested DOT:** 32281.38 DOT + 11007.34 DOT **= 43288.72 DOT =  $ 216,443.6**

**Previous proposals:** https://kusama.subsquare.io/treasury/proposal/280

### Motivation


**A) Archives**

Archives are an important piece of Polkadot and Kusama data infrastructure provided by Subsquid. They provide access to on-chain data in GraphQL format for all major parachains on Kusama and Polkadot, with more chains getting support as the ecosystem grows. They are being used as a data source for [Squids](https://app.subsquid.io/squids) and for efficient data exploration and ad-hoc queries. An up-to-date list of Archives is kept in a public [Archive Registry](https://github.com/subsquid/archive-registry/blob/main/archives.json).


All archives can be accessed and queried via an web intuitive GraphiQL interface and are often used as developer friendly replacement of a block explorer.


For example, here’s a query for the last ten transfers on Kusama blockchain run against the [Kusama Archive endpoint](https://kusama.explorer.subsquid.io/graphql).

![](https://lh3.googleusercontent.com/u/0/docs/ADP-6oF28QRWrAQx4x6nJNPA_fSg4c73ukxfq-ATwlJOaeMkFcveUEN3abJyXlkg0M5tgxMSU9_hY00ovl7JB0PIaZV25wlpNy9QiYTah8HYt1QcfnmUiLPz61vWbAjWe6yEsIrl_dVS68yi_skDsIhpTHtk0NqWhZ2HakawVgzv13cB0Zz2GFF1uD4WduGKh1cT71w21kf8XhbV9NU8bYkYjJht4UPz5CEmrc-J8V-1g6zjdMK0TWcbRtZE469tyZurbsR6hrxtz3AgcT-yBnIaFSR1RjuDt9cU4ON1EuhAYFfbt_hxKS5eJAmkJnoRN9b98lm3z-ENAW4F4lGD4eaefmLjW0Ni96jVwyx2-0qpj_FCU8M4Jv-ADArSOogQU6E4WMjJ0IXO0G0wvqcpJritTjnVfaMg1BWVP4coevffowL396wjU7-php3xXPT1cYJHRi9hob4LQQUYXeBz_oGA2mcZ-VTw8fonH_Q5H3MWRqaaPttS618JzrkVaeEGScCMF9qJ5tMwBeMFQ9rcG9njN1frHKgaco97oSsZsSygw-OsuCAyBta90ZmHWeHo3ZJqtRNBdE33rEzJlBvlVo4uCVbMnjE_64s5bz2-OQczY8bEdjD6v7g4awrLXZXwx1zdRnHkc5TZsnG65LhbYXzLus-n-drRCSuk-67GihaJrMul5IoKRgHaUJekuQVaFNnL4YhKAGOotb7tvvNCLdDtpfnwZdg_bhGrALNf8b4hGBfJL1_cHPeTeKj2IrsCBVz1cm7EQp6fx5VTXD3oJnwLkx09vmauHqlftCgqfzYjSvL5E2yWRHI5NZa5igjdV9UNPUvj_LB4-NvVx_RCofmUNjC62qj8AUYJH8z7RhIvGmpvpdesVlFgFqlB-VMhPd8emdb6l1089w7jrc3bODqhQuNtEbM)


Over first Quarter of 2023 we've provided a free public data indexing service for ~94 Substrate blockchains (some archives have been dismissed, new ones have been added), so that everyone interested in the projects can publicly access indexed data on Substrate Events, Extrinsics, Storage Items and EVM logs. Here are projects (parachains and mainnets aiming for future parachains slots) we currently support:

- kusama
- polkadot
- moonbase
- gemini_2a_testnet
- rococo
- khala
- astar
- moonriver
- crust
- moonbeam
- karura
- equilibrium
- shiden
- kilt
- bifrost
- statemine
- aleph_zero
- heiko
- acala
- robonomics
- aleph_zero_testnet
- calamari
- kintsugi
- parallel
- shibuya
- phala
- sora
- basilisk
- statemint
- interlay
- litmus
- origin_trail
- bitcountry_pioneer
- integritee
- clover
- picasso
- altair
- bifrost_polkadot
- centrifuge
- hydradx
- subsocial
- efinity
- tanganika
- t0rn
- cere
- litentry
- composable
- bajun
- invarch_tinkernet
- amplitude
- imbue
- foucoco
- phala
- dorafactory
- pichiu
- kabocha
- darwinia
- gmordie
- snow
- frequency_testnet
- peaq
- elysium_testnet
- gear_testnet
- reef
- collectives
- frequency
- pangolin
- myriad
- elysium
- ternoa
- soonsocial
- crab
- myriad_testnet
- polkadex
- kylin
- reef_testnet
- tidechain
- pendulum
- hashed
- joystream
- gear_testnet
- darwinia_2
- mangata_x
- mangata
- polymesh
- nodle
- reef_testnet
- automata
- lagoon
- crust_shadow
- agung
- kico
- gemini_3a_testnet
- mars


**B) Giant Squid**
Giant Squid is a set of open-source GraphQL APIs built with Squid SDK and maintained by Subsquid Labs. The APIs cover the most commonly used data for Pokadot, Kusama and a growing list of major parachains and is used by explorers (such as [Calamar](https://calamar.app/)) and wallets (e.g. [SubWallet](https://www.subwallet.app/)).

The Giant Squid currently consists of two families of endpoints outlined below. The API endpoints for each network and the current status are available at the [Status page](https://docs.subsquid.io/giant-squid-api/statuses/).

**Explorer API. The endpoint URLs follow the convention https://squid.subsquid.io/gs-explorer-${network}/graphql. Support queries on:**
- Blocks
- Events
- Extrinsics
- Calls


**Statistics API. The endpoint URLs follow the convention https://squid.subsquid.io/gs-stats-${network}/graphql. Support queries on:**
- Validator/Collator data
- Account balances
- Staking statistics
- Nomination pools statistics
- Transfers statistics
- Extrinsic statistics

### Achievements

- Launched Giant Squid as a public API service for the community to explore relay and parachain statistics
- Powering ≈ 360 projects in Q1 2023 ( ≈ 500 as of May 2023) including substrate and evm
- Deployed new archives, expanding the list of available networks to 95 (increasing by 200%)

### Statistics and data

![](https://lh3.googleusercontent.com/u/0/docs/ADP-6oE4gjNTMvIJzUcwpsoOS3QhjQOo83ctejXjAysetgejrg1lhMFTJg83864WWJ2El1LC1quSf3qiGLkLTacFV4DksQDzwPOspS8WX-EUrHYfFLrdnmyO1l3n9GoE0ODP1X79e9sKjWOZceqGCrv1P8qyA0Ck7UhCyhRYe0zo0OPCytDffBHmjJywd8t_v8eR5WGw6CC1mo72GC64CY-FolQyFJjTCg8lHTRcwkvDGOqeJy4Zy2n8IdFusb2Ihmp4rALBxWcYbTwIBQZpJkVUvbga6MRIMZq6gABzVuYYki1vwQvHiOltaYJ9Kn_Kcp2GVdEXkEASyfrVpzqaIv2q5w1Y1_3ucUC49n9GeSMcMDVvNcC8tZsbq_xGK8gnKQq02hYaqxUD9KOKGKH8n9GltLdvn-8fij-SmC-jPUlUpy9kwr3TGUrXGU7FMelL3qVYYFCmDQ0J-keg7_Hll4UDg3mn0lMhK5AdY6KkNmV-9DUe8fGcoD_wJebDLsMlM0IbNgDmgpuO7GUWqyXiQ_adbcVoUnnlq9s1ZoHsFVCJvhugIF_kQWIDXDToFG7rRsgv-9fj6vVxUdxY1peBWpYHi-F6zUxynuxDh71L9K3xN-yKzurJBgwdpYvxal4WKKPrtuQZF5P2QCswlfVjAsQFx3BFNfT2G6fGA-pu-AarMDovEYy0lZzrN1TxCDeV3gyUoNDDF16VmTLCoe5XpHxM9-6Z7whEoKYg0BiQfCPgksZwdhKqZg3ICTank0XoGoHZ29dRupaDdxPURzA9fRsgfbh4Pe2J1VVA_1kMIbwmL9HhIo5mpeFSg3vsYVHrsH56qN08-VTUJmdDXJUFRPvcCG-mlH0h94Ez5Rfk_-a0Gr0ly-Q1cUK4AX5SrQzkW2f675xXaEIdO8bphdIJ5Cwz1Oya_do)


![](https://lh3.googleusercontent.com/u/0/docs/ADP-6oHcKHUirSow9ztILPzv7zpT4gfUbiCQkm4lhyF2D4rkv6n17Y1MpD2vgyZFkkm0ABoW50bnxvIzjcozdsEOsq931QV6ZU3v3xk78-EbjH9N58kcgjAFBfQw2ZH5KljU6mU1e4tOTgV-BYq6mbmCTAvpQBnAz9gFKz9HVNwufXEMfo9NWxAv3jCd86AlxC65ZSV-nVBkxc7oypDMXBTCTu92bNJwIeBYvnEIbrL2GDoehA6QqNtuELOfcEh0qDIVmaKC_6jPojGEf4SAL6x8gPleUPxzKuF4OEhmRFUSVJQ0nKKnz85GO4D5aDa1_m9TaHsBPduI6acO8BNTn3dO8sTsKxVUmp3PLs_XDr4GR-OfGNFRUcSYoFUWwWit9wXGFhFRoRKZTOFSmIcPuQ6OgxB4iX6-C6dKvHiU5DAxbQT6Wold-LuxkImXqNIH9DqmS9VihqE3lhghVYq3EtYoZlx_M6uuEqVIegDKLv9lk6tzMptw0cVyypXCtts-l0Rd9lnFNF493PhBcuzOo3Pqge0tI27B00K-bX9fMGcJ21EHkZo139IxsUYn8n5T9yXiUGARQVCg55Xt5X9tIwPEcc2OPj1QEsWEGp4yY59qm33-x9lkFE918FkceS-aZee5p-s6VL88_J-1APszBWHtFYg55S8-UAfWKYlhXpQ8Y26ZL3WEoNUFUv-UQpPJ65hwfjbdc4K6_vyQ_VYMAEdgLV3u9G2wkTyQTs005dbWGGYxBFI7ga-eTohLmQ3E0iBTYsyOG6YMOWVsyz8U3IQWKCZ3x_lO8GBcjX37qvLhgZ1sjRumjA8-9XI1CsKU3BfGMlm2ASYlkvtnWzAW2drTKyCiRbcFEwjs6d1NXBywyJ-Ql-RCdEZuawc3REVBvBFDssO-EdRfvixZRojAiYZl1JWIvMc)

**Over the course of Q1 2023:**


- Served a total of 162,509,254.3 (~162.5 million) queries to the substrate based archives in Q1 2023
- Served ~54m monthly archive requests for substrate based archives and ~ 400m monthly archive requests in total  including EVM Archives
- The highest daily total responses have been 2.3m in a single 24 hour period for substrate and 12.3m including EVM Archives
- The daily queries confirm a growing trend, only partly due to the deployment of new Archives (which initially are not very busy)



Giant Squid is a new service, and has been launched in mid-January, here are two charts showing its quick adoption by the community, as an index of its success:
 

![](https://lh3.googleusercontent.com/u/0/docs/ADP-6oE6P3xTCMJPooMU0MvARg2aj2tyo6nFO1Trp6VLFMJUjWyPpRQCa863ecVmszBYwCTubrai3-qcKjjbyJlp9T9KEwUB9SjEG_S5iSCxWgiO7PPpuB8rou4z7r6BGOVS7CUVOnekq68fCxgZGcvaAhjYG-tf4-L3ywlnsMvMaSVVtorlJL8payuS3uhGXSnQyR0fYJivtevwnON5ybqqKos3iwBJswvjiEO8Oq7eYw9B6v283IH0x-AuHJdCEQitMc-bUFXDlNOwSn-UROoZ7gs9PN_v-cbjAoIKK2DQ4_9d4k5Bng9UXzQGJWz3RWm2GVv_L1iTBoszQAxLyxWKh_KGMClpv1ny7lYnUpIQQXaieG5AxofDBI4F1Wf1YcJtKoVmVrXOntW1gn4SVDmhVMXIargBQ2lTRHIaFpAJu9SLWDEUrdDVJeaCa-tHW4_GYZPpu9XTEnDIid8Q4e4zOxlyQuNF4Em4Ahg7hHuRreZ0LJ7FYTYCLCYLbe5M1h9p91nzBEyzwuzSHBuMVZL1jy9kdL3c5kODbkYFyl03UjiLze0K5VQN-H3YjmfJO60jVRg91u0sHn9Wh2-_Ed_j_BCrAJINxeNsVg_0rR2bl0WglUGlHjuvBqtJDqp6BI-hDZgaCVIB5shxJX7E9r2sC8NtaTudIxkfMgxHRmpllFsZ5fnZLkuWcwgPh3XRADfJjtdrI_gupEtiMAac4QxezN5NiTDUx2j0TUWTdGOTeCdwhwSKflouslRzQROLh8nwyB3Y9m3mJOkhHf9s9DS3163Qu82LNeNocue2bXfWzNHiCUTIJnorQf8DK-juX_c2iC-rXAl3wLTeYrbKOD_O4ShcGrrZFibhjlOZkHak0nvt160CSG04x3VJUoTLBVRnYAP4Yy401vgiLqKq1jHIBhv-QHs)


![](https://lh3.googleusercontent.com/u/0/docs/ADP-6oHjyacO1spY-9wlFrIDas5cFnC1wLmsFP4_ioJYwM5GcfTDH2zq1DaIlolqgkUKzYueUjWbbZw1JYcpUAuIlbM4P44q3z-VNnfaJjDnC66Q4ESiqzSCDt0rqtO-6I5YDQW56QttazehxFVxj_VC1eeKYYHjDlapyN1pykcYbG8ulFCj0hZJko84zQFU5SuiYIrwY_YGp3bUPO3_o2iuygXD7oCLSgOCbpjTXlQBPK4SwFFtIDWB5hadunJoA7dYMJ-iVvO4RCn-329h6CXaVea8TRte_XayYfndo4MFAl8caJYFqBb-Hln7Y3bM8Osf22o9LBJMg1Mr7pDJkKPEcnTLU1KrgnxOQLPIIzvSW-VLss11CuVTXXNxYUGN_bECPqp93yHkNTNeAQlL4AdS5is30AFpIrKU6fMZmHTlkyR5YStSg_UiJ-8e-ijgVTUx-F5CG7gp8092K-XCoeq-G4OBHHZTLkDAC1Gv_UZymwL4_kIg5JD-2SzENgD7P5WepX9ndV-xxYb_j_1qccvlZLQEiJuJJ3bkO-rp0OmPuy3YnXfNee951bUKqdCEdLDEFqtIxXwea82NUH4IBJwlwSgou4EP4pwVX6zhbrpdvS2gbTucFzEtDsntnjLFz5_ufEWiPtw782og5etoB8lWa9AyP4JqmtrXxmKgbb-AbKGPhbzIPq0xs8dRBOi7Du1RQbYWGpks3Mal7s8obHm1qz5AlGX3rtvvcXoZJ2GPnGwDpiAQkyxxCkLb9pnNtCJGAGw8z-po7sKuhWVXTGDUvHcpEi_gQJwq7CEINcMoOvU5wBCLubH7CafpfRuJp8zw8XZi4K7NaxLegPiGHmL0ZvIJOerE-xdPmtuO97XZaXAdMz8dtGzoT2DwOIQLaYROKk80j2amgMle05Jf0_UBlSSVnsg)

### Costing

This proposal includes the combined costs for running Giant Squid and Archives for Polkadot, Kusama and their Parachains,which amounts to a total of  **43288.72 DOT**.  Raw data for Archives can be seen [here.](https://docs.google.com/spreadsheets/d/e/2PACX-1vRW2UJeY6qR2RiCFfBZ70EZ3i45sc03kizxwgXrJdIqfkn6ygDkRDVNElXmzP3bK9ENB5weUyFM9pvP/pubhtml#) Raw data for Giant Squid can be seen [here](https://docs.google.com/spreadsheets/d/e/2PACX-1vRrG2wW7XXcsfgY-AGp-luHvhu5H-uQWd7xcli84celv42g9SctqA6JOMdZOYJCf_3hBvh3VFIf_GfG/pubhtml).

The proposal is submitted towards the Polkadot treasury. Here is a summary of the running costs for Archives, in a tabular format:

![](https://lh3.googleusercontent.com/u/0/docs/ADP-6oGLXrwMpju2MZvkWec3PWfBdDBQCEoq-cueoHlusTHZT2mP9IbsePxh3aiPi60eSU3e90ajnsYm--SzfGxoRqcVPw63sVmPqrjUHDMnugEartm5WOpEOp0eMg6S1UTEij8i5Rt8KdfYknh2_xmGqNBBlyl7pom0RKes4KAqWAk48LBVZyVTaULRlMJIGpAt8igPdTBywq2jaYsck_T8QqtLPD9amh_0Mm0HfJgQPgW61UEgjfUiaardN98ZFc34jmxVQaXJ9NJj8EkaBRiKZ2G1i52DB-HnweX4AX1Lv-n4jsYtvvmpGVfdQo_Th05dR8LotxiMZnJauZR0YioA5AXYuk3K431r-ZreT9SNpFwlbmqpceqO6vWJryet1Bi4JjDy2UvyG6A9MdRrldKwFJ_djpZQxT2E-CIIkyXer97QYaOOx8CJw7TbYLg8QVQIsily5nQ_MD0EzlHEOeNoneLaU_j7bdkKyOuDTuZqErd3Em8VG3YKHR5egStL0Pa9gUN2Oc6ce0VcpUvF5vwHavaxQHlHFEslO2QWClUnqNQM0xbXFJEjKLeeI9IyvLCXMeG7OPA0Nj5YD_U82xWOFxKZhqXy-gDpUbdnxPFHR6oCjsnCbiGhzxCUFaU2zYUUV9Uwp2fpOh283tzXGW0ZUjZJR2W38RfhT_r7hqaAbGgOy5uD11T-qrnM1c-c-tVvz5KxepbpS1N8VhH-llUZ91ysKXPA6kVRMQ9DfVyOJznx1w2jbU2mtRLsUVNjy3fo-wdF4qF6J4Z0nlyFV9l8r8OXWPy2IQAjVwov5LXN7K3XrhnLhZyPK5Nw_T0xhFsJC0rXnvdosowqfCKcFW1WeD7h0hHRg4Ia00dZdIAJJvgK_sdK-QaH-scl0qKp5pukQVr_r_sL2Fmg32dxC1Srr7-s3CI)


Giant Squid running costs:

![](https://lh3.googleusercontent.com/u/0/docs/ADP-6oECA6Ug6xRXrBqalWtiCnHOPeyqc4ZeCInTf0DnQPuc_p8c7eghWpL8x6FRqBBrFk2sIt0m5M855BIlQqw7eaJ1_2bDi6keJLIdkHQDwHgtwlAvO3fjf5K90iug119A9Uq8GpiHgua8LiTV5Qu_cajWgMIZE7y_knC8ExAr14ziSF6kLXLLyOGMqeyLt40wezQWIq0y-YXQgFjzzzPq3T5fdgtb9tLyjJH9aTfjixvrxx5XjjFEFTyXQIIml7oX7K9PHXf3X0me8A0F9RDfdaktVKvIOScHtfgftC8cTm39pm5aSho2WpjoMU5hhLiVpGKB7KTEJw48f5wb-FawdGQtQSE-uG7Wuj0B9qeOIvBER-vfBc1u2kX1gDnoc1Uk0jyQXXrrOwnFux1j_bWFAKJCm-1nUXc_LUyrNAKTdMhhJEKzL55WKhALBRI0EUD71MoDNONhCwyQnPQcKNZtWC7cDyy_HbqZ2zaTkUDxaLZSvxTtOhoQJOwFa-qY1Fc2C5W9pE_7-WcPFLrycLLogQUXTSi42p6OXKuJbdluWJd3ua4ASpCy8Qw1kMYNaCLnVy0avTGELJdo8qw1zwOKDq-iv8RE3pI-WT_SkGSGph1vcQaO3PDec6CoInzJCKo7oLtmJZMzwblSoZgjIdyliMzSgAEVtKoy5_0bF638GQH-AwQRWozPSpeu0dOBs-LwsoVgLaQ-0IKtb1NsWwkCr9MSBXZe1UXVV9JHTSRHJ1Q77XzfF6Bz2uSB-0GAcOm5aXiGUgKSySBmhMEchbL5r94OhjcbCaR65h2Dpca3b6yjemd42ueENBN4wdb3VgSSjZu1mCfRDSQihDakISKAnqYfsL6cxAa1uGVImghyEUz6_VxJaT4VDMyiN0aSNVGzxSQzlBZk3F6KfCssRcD-1i8jexY)

You can read the full report[ here](https://docs.google.com/document/d/e/2PACX-1vTa-xOKI7UdGXcTDybuTekej7LqAjqXBqPPrctJv3FfF9GO5xTblUB5FTa0in6MNj68JFLj-NRMJ6lI/pub).



- Problem Statement: The Polkadot and Kusama data infrastructure provided by Subsquid Labs, including the Subsquid Archives and the Giant Squid API, require ongoing development and maintenance. The intended audience is the Polkadot community and developers.
- Significance: These services are crucial for accessing on-chain data in GraphQL format for all major parachains on Kusama and Polkadot. They are used for efficient data exploration and ad-hoc queries, and are essential for the functioning of various projects.
- Proposed Solution: Subsquid Labs proposes to continue the development and maintenance of these services, and requests a total of 43288.72 DOT from the Polkadot treasury to cover the costs.
- Expected Outcomes: The continued operation of these services will support the growth of the Polkadot and Kusama ecosystems, serving an estimated 500 projects as of May 2023. The services are expected to handle approximately 400 million monthly archive requests, including EVM Archives.

#1811 Subsquid - Public data indexing Infrastructure for Polkadot and Kusama (Q1 2023)

No Active Proposals