Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[1.0] Refactor data layer #818

Merged
merged 13 commits into from
Apr 19, 2017
Merged

[1.0] Refactor data layer #818

merged 13 commits into from
Apr 19, 2017

Conversation

KyleAMathews
Copy link
Contributor

@KyleAMathews KyleAMathews commented Apr 18, 2017

  • new node schema"
  • New cache module for typegen plugins to cache their data
  • Save and restore node data state (time to finish bootstrap for one larger site dropped from ~45 seconds to ~5 seconds).

TODOs

  • change "parser" to "transformer"
  • move .intermediate-representation to .cache
  • add tests for transformers
  • refactor graphql query runner and cache queries and query results
  • write out images to .cache
  • ensure hot reloading of content/queries working correctly
  • document node
  • HN clone with new source plugin for HN data

* new node schema w/ "content digest" required instead of ad hoc "hash"
key
* New cache module for typegen plugins to cache their data
* Save and restore node data state
@fabien0102
Copy link
Contributor

@KyleAMathews I already move .intermediate-representation to .cache into #802 ;) (you have mention it into targeted directory structure ^^)

@KyleAMathews KyleAMathews changed the title WIP: Refactor data layer [1.0] WIP: Refactor data layer Apr 18, 2017
@KyleAMathews
Copy link
Contributor Author

Indeed! I'll merge that branch in a bit.

@gatsbybot
Copy link
Collaborator

gatsbybot commented Apr 18, 2017

Deploy preview ready!

Built with commit 863e9ac

https://deploy-preview-818--gatsbyjs.netlify.com

@gatsbybot
Copy link
Collaborator

gatsbybot commented Apr 18, 2017

Deploy preview ready!

Built with commit 863e9ac

https://deploy-preview-818--gatsbygram.netlify.com

@KyleAMathews
Copy link
Contributor Author

I'm going to just merge this and work on the remaining TODOs on subsequent PRs.

@KyleAMathews KyleAMathews changed the title [1.0] WIP: Refactor data layer [1.0] Refactor data layer Apr 19, 2017
@KyleAMathews
Copy link
Contributor Author

And as of a18ee33 we're now actually building the websites from the latest code.

@KyleAMathews
Copy link
Contributor Author

We do a Babel build of all src code and then copy the packages into the website overwriting what was installed from npm. It uses gatsby-dev-cli for this.

@KyleAMathews KyleAMathews merged commit e7ad98d into 1.0 Apr 19, 2017
@0x80 0x80 deleted the refactor-data-layer branch April 19, 2017 20:25
mwfrost pushed a commit to mwfrost/gatsby that referenced this pull request Apr 20, 2023
* Refactor data layer

* new node schema w/ "content digest" required instead of ad hoc "hash"
key
* New cache module for typegen plugins to cache their data
* Save and restore node data state

* rename 'parser' plugins to 'transformer'

* Update tests + add basic tests for gatsby-transformer-json

* Add simple tests for yaml transformation

* Add a test for transformer-sharp

* Rename function

* Add test for transformer-remark

* Build and copy over built src to websites when building them so they're truely running from HEAD

* Require the HTML component from the new src directory

* Make imports relative + remove gatsby-helpers

* Move fonts from the static directory to the src directory since we import with webpack

* Correct path
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants