WIP: Bootstrap optimisation lld flow #2943
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Making LLD Changes For FileCopy * Making LLD Changes For FileCopy * Making LLD Changes For FileCopy * Commit For request API and File Copy Manager * Update File Copy Manager
* Support AbortMultipartUpload for S3 API --------- Co-authored-by: Shan Xu <shaxu@linkedin.com>
* Support rename dataset version in AccountService * Update to use the colum map to original value * Adding more test and details * Adding handler logic * Address comments * Empty commit to try and rerun unit test * Empty commit to try and rerun unit test * Address comments * Code refactoring * Fix bug for delete * address comments * code refactor * Addressed comments --------- Co-authored-by: Sophie Guo <sopguo@sopguo-mn2.linkedin.biz>
Co-authored-by: Navneet Sachan <nsachan@nsachan-mn1.linkedin.biz>
* More Changes For LLD * [S3 API] Support for S3 AbortMultipartUpload API (#2940) * Support AbortMultipartUpload for S3 API --------- Co-authored-by: Shan Xu <shaxu@linkedin.com> * Support rename dataset version (#2935) * Support rename dataset version in AccountService * Update to use the colum map to original value * Adding more test and details * Adding handler logic * Address comments * Empty commit to try and rerun unit test * Empty commit to try and rerun unit test * Address comments * Code refactoring * Fix bug for delete * address comments * code refactor * Addressed comments --------- Co-authored-by: Sophie Guo <sopguo@sopguo-mn2.linkedin.biz> * add local store to logs (#2947) Co-authored-by: Navneet Sachan <nsachan@nsachan-mn1.linkedin.biz> * Updating LLD Flow For bootstrap * Updating FileStore Class * updating commit --------- Co-authored-by: Shan Xu <alyssaxu333@gmail.com> Co-authored-by: Shan Xu <shaxu@linkedin.com> Co-authored-by: sopguo <sopguo@linkedin.com> Co-authored-by: Sophie Guo <sopguo@sopguo-mn2.linkedin.biz> Co-authored-by: Navneet Sachan <nsachan@linkedin.com> Co-authored-by: Navneet Sachan <nsachan@nsachan-mn1.linkedin.biz>
aga9900
commented
Nov 26, 2024
| handleFileMetaDataRequest(networkRequest); | ||
| break; | ||
|
|
||
| case FileChunkResponse: |
aga9900
commented
Nov 26, 2024
|
|
||
| private boolean running; | ||
| public PrioritisationManager() { | ||
| diskToReplicaQueue = new HashMap<>(); |
There was a problem hiding this comment.
rename queue to map.
aga9900
commented
Nov 26, 2024
| public static final String STORE_DATA_FLUSH_INTERVAL_IN_MBS = "store.data.flush.size.In"; | ||
| @Config("store.data.flush.size.In") | ||
| @Default("60") | ||
| public final long storeDataFlushIntervalSeconds; |
…ition flows (#2946) * Changes for bootstrap improvement with statebuild * Added initial changes for state build * Changes for moving state build to FCM * Changes for state build including FCM invocation * reformatting changes --------- Co-authored-by: Jai Balani <jbalani@jbalani-mn1.linkedin.biz>
Co-authored-by: Jai Balani <jbalani@jbalani-mn1.linkedin.biz>
…For Meta Data Chunks (#2958) * Fixing Build * Updating PR For State Build * Updating PR For State Build * Update Buld Fix PR * Updating with remote * Updating the Flow For File Copy * Fixing Conflicts * Fixing Conflicts
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.