Subgraph Composition : Fix graph init for composed subgraphs #1920

incrypto32 · 2025-01-27T11:57:41Z

This PR enables graph init for composed subgraphs. It creates a new ipfs client to validate the source subgraph manifest

changeset-bot · 2025-01-27T11:57:45Z

🦋 Changeset detected

Latest commit: 40dbe07

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package

Name	Type
@graphprotocol/graph-cli	Minor

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

github-actions · 2025-01-27T11:58:31Z

🚀 Snapshot Release (`alpha`)

The latest changes of this PR are available as alpha on npm (based on the declared changesets):

Package	Version	Info
`@graphprotocol/graph-cli`	`0.96.0-alpha-20250204073305-7683939381c6f3f5fddf2739cc76fa56a2e90317`	npm ↗︎ unpkg ↗︎

cloudflare-workers-and-pages · 2025-01-27T12:05:06Z

Deploying graph-tooling with Cloudflare Pages

Latest commit:	`40dbe07`
Status:	✅ Deploy successful!
Preview URL:	https://dbb112bc.graph-tooling.pages.dev
Branch Preview URL:	https://krishna-comp-fixes.graph-tooling.pages.dev

View logs

YaroShkvorets · 2025-01-29T23:56:37Z

@incrypto32 could you fix the linter error?

YaroShkvorets · 2025-01-30T00:05:38Z

I think there are some issues with running github actions in your branch after #1919

Rebasing on top of the latest main should help.

incrypto32 · 2025-01-30T07:54:18Z

@YaroShkvorets i just rebase on top of main and the issue persists. I cant figure out what the lint issue is, also im not able to run the lint locally. Getting these error


Oops! Something went wrong! :(

ESLint: 9.19.0

Error: Cannot read config file: /Users/krishna/dev/work/edgeandnode/thegraph/graph-tooling/node_modules/.pnpm/@[email protected][email protected][email protected][email protected]/node_modules/@theguild/eslint-config/src/index.js
Error: Failed to patch ESLint because the calling module was not recognized.
If you are using a newer ESLint version that may be unsupported, please create a GitHub issue:
https://github.com/microsoft/rushstack/issues
Referenced from: 
    at Object.<anonymous> (/Users/krishna/dev/work/edgeandnode/thegraph/graph-tooling/node_modules/.pnpm/@[email protected]/node_modules/@rushstack/eslint-patch/lib/_patch-base.js:167:19)
    at Module._compile (node:internal/modules/cjs/loader:1469:14)
    at Module._extensions..js (node:internal/modules/cjs/loader:1548:10)
    at Module.load (node:internal/modules/cjs/loader:1288:32)
    at Module._load (node:internal/modules/cjs/loader:1104:12)
    at Module.require (node:internal/modules/cjs/loader:1311:19)
    at require (node:internal/modules/helpers:179:18)
    at Object.<anonymous> (/Users/krishna/dev/work/edgeandnode/thegraph/graph-tooling/node_modules/.pnpm/@[email protected]/node_modules/@rushstack/eslint-patch/lib/modern-module-resolution.js:11:23)
    at Module._compile (node:internal/modules/cjs/loader:1469:14)
    at Module._extensions..js (node:internal/modules/cjs/loader:1548:10)
    
    ```

YaroShkvorets · 2025-01-30T14:50:30Z

Looks like it's passing. Good for review now?

incrypto32 · 2025-01-30T15:19:21Z

@YaroShkvorets yes, ready for review

YaroShkvorets

Remove hidden: true from --ipfs flag on line 117
There doesn't seem to be a way to scaffold a subgraph-based subgraph in non-interactive way from command line. Is it possible?
this command does nothing and exits with code 0 without any error: graph init test test --from-contract=0x0 --protocol=subgraph --network=mainnet

packages/cli/src/commands/init.ts

packages/cli/src/utils.ts

packages/cli/src/commands/init.ts

incrypto32 · 2025-02-03T10:29:57Z

@YaroShkvorets just addressed the comments, the CI is failing but i think its not related to the code.

YaroShkvorets · 2025-02-03T18:47:45Z

@incrypto32 A couple of things:

Remove hidden: true from --ipfs flag on line 117
It always defaults to startBlock=0. I think it would be good DevEx if it defaulted to minimum startBlock from the source subgraph data sources.
There doesn't seem to be a way to scaffold a subgraph-based subgraph in non-interactive way from command line. Is it possible?

…ource

incrypto32 · 2025-02-04T08:21:54Z

@YaroShkvorets I just added the support for non interactive mode and addressed the other comments too.

YaroShkvorets

--from-source-subgraph is fine by me, but wouldn't --from-subgraph be more concise? "source" seems redundant.
If you don't specify --start-block in non-interactive mode, it goes with undefined:

❯ graph init usdt usdt --from-source-subgraph QmaNwrB6x9oiB2NZkbPsSjkCWhMT7gzH3NKYR8ESYpcyNW --protocol subgraph --network mainnet
  Generate subgraph
  Write subgraph to directory
✔ Create subgraph scaffold
✔ Initialize subgraph repository
✔ Install dependencies with yarn
✖ Failed to generate code from ABI and GraphQL schema: Command failed: yarn codegen
- Apply migrations
  Skip migration: Bump mapping apiVersion from 0.0.1 to 0.0.2
- Apply migrations
  Skip migration: Bump mapping apiVersion from 0.0.2 to 0.0.3
- Apply migrations
  Skip migration: Bump mapping apiVersion from 0.0.3 to 0.0.4
- Apply migrations
  Skip migration: Bump mapping apiVersion from 0.0.4 to 0.0.5
- Apply migrations
  Skip migration: Bump mapping apiVersion from 0.0.5 to 0.0.6
- Apply migrations
  Skip migration: Bump manifest specVersion from 0.0.1 to 0.0.2
- Apply migrations
  Skip migration: Bump manifest specVersion from 0.0.2 to 0.0.4
- Apply migrations
✔ Apply migrations
- Load subgraph from subgraph.yaml
✖ Failed to load subgraph from subgraph.yaml: Error in subgraph.yaml:

  Path: dataSources > 0 > source > startBlock
  Expected BigInt, found string:
  undefined
error Command failed with exit code 1.

YaroShkvorets · 2025-02-06T04:46:35Z

packages/cli/src/commands/init.ts

@@ -596,9 +656,14 @@ async function processInitForm(
        isSubstreams ||
        (!protocolInstance.hasContract() && !isComposedSubgraph),
      initial: initContract,


If you specify --from-source-subgraph Qmxxxxxx, this field should have initial value Qmxxxxxx

incrypto32 force-pushed the krishna/comp-fixes branch from 55c1f2b to 111a264 Compare January 27, 2025 12:05

fordN assigned incrypto32 Jan 29, 2025

fordN added the area/cli label Jan 29, 2025

alex-pakalniskis requested a review from YaroShkvorets January 29, 2025 21:48

incrypto32 force-pushed the krishna/comp-fixes branch from 8e5191c to 2a7cf51 Compare January 30, 2025 07:44

incrypto32 added 5 commits January 30, 2025 11:51

Fix subgraphs without abi field failing to build

fddfea6

Fix graph init for composed subgraphs

6b9f04b

Add changeset

b065646

Fix validation not working

735b565

Support declared calls in manifest

600280d

incrypto32 force-pushed the krishna/comp-fixes branch from 2a7cf51 to 7efc3f2 Compare January 30, 2025 07:51

Lint fix

3a75a7f

incrypto32 force-pushed the krishna/comp-fixes branch from 7efc3f2 to 3a75a7f Compare January 30, 2025 08:13

YaroShkvorets requested changes Jan 31, 2025

View reviewed changes

Address review comments

a074696

incrypto32 force-pushed the krishna/comp-fixes branch from e5a3df7 to a074696 Compare February 3, 2025 10:12

Dont allow adding new contracts when subgraph is a composed subgraph

ce24548

incrypto32 requested a review from YaroShkvorets February 3, 2025 10:28

incrypto32 added 2 commits February 4, 2025 11:17

Allow init of subgraph datasource subgraphs without the interactive mode

b7b6bbf

Reduce code duplication between subgraph datasource and normal data s…

2ae4c2e

…ource

incrypto32 and others added 3 commits February 4, 2025 11:23

prevent using --from-contract and --from-source-subgraph flags together

9ed22cf

cli: validate protocol and source subgraph relationship

7683939

chore(dependencies): updated changesets for modified dependencies

40dbe07

YaroShkvorets requested changes Feb 6, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Subgraph Composition : Fix graph init for composed subgraphs #1920

Subgraph Composition : Fix graph init for composed subgraphs #1920

incrypto32 commented Jan 27, 2025 •

edited

Loading

changeset-bot bot commented Jan 27, 2025 •

edited

Loading

github-actions bot commented Jan 27, 2025 •

edited

Loading

cloudflare-workers-and-pages bot commented Jan 27, 2025 •

edited

Loading

YaroShkvorets commented Jan 29, 2025

YaroShkvorets commented Jan 30, 2025

incrypto32 commented Jan 30, 2025

YaroShkvorets commented Jan 30, 2025

incrypto32 commented Jan 30, 2025

YaroShkvorets left a comment

incrypto32 commented Feb 3, 2025

YaroShkvorets commented Feb 3, 2025

incrypto32 commented Feb 4, 2025

YaroShkvorets left a comment •

edited

Loading

YaroShkvorets Feb 6, 2025

Subgraph Composition : Fix graph init for composed subgraphs #1920

Are you sure you want to change the base?

Subgraph Composition : Fix graph init for composed subgraphs #1920

Conversation

incrypto32 commented Jan 27, 2025 • edited Loading

changeset-bot bot commented Jan 27, 2025 • edited Loading

🦋 Changeset detected

github-actions bot commented Jan 27, 2025 • edited Loading

🚀 Snapshot Release (alpha)

cloudflare-workers-and-pages bot commented Jan 27, 2025 • edited Loading

Deploying graph-tooling with Cloudflare Pages

YaroShkvorets commented Jan 29, 2025

YaroShkvorets commented Jan 30, 2025

incrypto32 commented Jan 30, 2025

YaroShkvorets commented Jan 30, 2025

incrypto32 commented Jan 30, 2025

YaroShkvorets left a comment

Choose a reason for hiding this comment

incrypto32 commented Feb 3, 2025

YaroShkvorets commented Feb 3, 2025

incrypto32 commented Feb 4, 2025

YaroShkvorets left a comment • edited Loading

Choose a reason for hiding this comment

YaroShkvorets Feb 6, 2025

Choose a reason for hiding this comment

incrypto32 commented Jan 27, 2025 •

edited

Loading

changeset-bot bot commented Jan 27, 2025 •

edited

Loading

github-actions bot commented Jan 27, 2025 •

edited

Loading

🚀 Snapshot Release (`alpha`)

cloudflare-workers-and-pages bot commented Jan 27, 2025 •

edited

Loading

YaroShkvorets left a comment •

edited

Loading