Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Multi-threaded Asset Loading + More (#6)
* Moving around some ideas for a new texture system * Getting the first phase of async texture loading working * Setting up texture descriptor pool for texture system 2 * Making progress at getting the new texture system in and working. Replaced usage in the view system and it works. Next we replace the old texture system entirely. * Replacing the old texture system * Fixing log to actually print * Vulkan debugging breakpoint * Adding missing config.h.in changes * Lots of little texture load fixes * Fixing sync problems * memory mapped io for faster asset loading * Adding the concept of a thread local allocator * Fixing build for posix platforms * Texture loading no longer blocks the main thread * Fixing silly error * Another attempt to fix build * I swear I can fix this * Refactoring queues * Some deduplication * Sketching out the new material system and a couple other quality of life and bug fixes * More sketching async material loads * Loading materials that load textures * Making progress on figuring out how to get materials to chain load textures * Materials go through the new loading process * _Thread_local to thread_local * A bit of renaming * Fixing some material sizing issues * Progress. Just need to fix bistro * Fixing materials not loading * Some misc fixups * Fixing static windows build * allocator.h to tb_allocator.h * Renaming and trimming files * Sketching out the new mesh system * Some mesh systems * tb_engine_config * New mesh descriptor update system * Sketching mesh load system and fixing string dependency in material->texture loading * Fixing system not running * Sketching out some ideas for scene loading as well as getting async mesh loading to get data into driver owned memory * Handling submesh loading * Refactoring cmake presets to be a bit more flexible * Fixing presets * New loading strategy and descriptor write flow The new mesh system is invoked which is sadly very slow due to descriptor pool thrashing during load. The solution will be to only resize the descriptor pool when a scene has finished parsing all of its resources * Textures now load in phases to reduce descriptor thrash * Similar phasing strategy for material loading * Scene2 drives mesh loading * The new mesh system is plumbed for rendering but meshes aren't drawn properly yet * Fixing problem of how to identify meshes across multiple sources * Fixing failure to deduplicate material entities * Pinned tasks are now a way for systems to exfiltrate work outside of a readonly system * Removing more of the old mesh asset loading systems * Reorganizing a bit of the water systems * Meshes render again though with some problems * Some instrumentation and profiling fixes * Finally figured out why we'd get validation failures with tracy * Fixing meshes * Fixing obvious warning * Fixing a small issue in FINAL builds * Rough but functional improvement to gltf loading * Fixing build * Major progress on async scene loading. Still working on getting entities loading correctly * Fixed rendering but parents are screwed * Scene waits for entities to have components report readiness * Fixing parenting issues * Making sure entire scene gets parsed properly * Removing log and fixing crash with bistro * Improving scene loading. Can't load bistro yet but making progress * Progress on making sure loading completes. Smaller systems like the ocean test work but bistro isn't there yet * More loading UI and making sure not to overrun descriptor pool * Adding a progress bar for my own sake * Removing an unused variable and making sure that entities popped off the queue are loaded * Fixing some loading problems. GPU timeout remains * Sketching out descriptor buffer structure and API * Initializing descriptor buffer in the texture system * Making sure the descriptor buffer can be replaced inline * Cleaning up some of the buffer address access pattern * Migrating the render object system to descriptor buffers * Working on getting the descriptor buffer up to meeting the needs of the view system * Fixing build * More progress on descriptor buffers * Migrating mesh systems to descriptor buffers * Descriptor Buffer code path compiles + some refactoring * Validation layers stopped screaming but loading never finishes * Loads and runs but doesn't render yet * Fixing silly issue with buffer indices not being set properly * Fixing sky * Defining TbShader also sketching out what an update to the sky system would look like * An attempt to get the sky system to work with descriptor buffers that doesn't work but doesn't crash * Fixed the sky Descriptor Buffer not working * Small fix to make sure that the mesh and material systems don't try to write more descriptors than available * Some cleanup and improvements to reduce crashiness * Some extra cleanup * Working on a better descriptor access pattern * Updating material descriptor approach * Updating mesh descriptor system. Doesn't work lmao * Fixing the dyn desc pool not writing the correct resources. Still have a GPU crash * Making some of the descriptor API a bit more ergonomic to rule out crash sources * Seems less crashy when we remove some complexity * No more crashes * Time slicing mesh uploading * Fixing minor warning * Smoother loading by breaking up scene loading * Separating shader optimization flags from debug info flags * Moving the concept of a free list to its own module so I can reuse it * Reducing per-frame work that has to be done by the render object system
- Loading branch information
1 parent
1f240f1
commit a497360