Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Register
  • Sign in
  • W wendelin
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 1
    • Merge requests 1
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • nexedinexedi
  • wendelin
  • Merge requests
  • !45

Data lake changes

  • Review changes

  • Download
  • Patches
  • Plain diff
Merged Roque requested to merge rporchetto/wendelin:roque_data_lake_2 into master Jun 19, 2020
  • Overview 5
  • Commits 9
  • Pipelines 0
  • Changes 44

Change in the way wendelin handles split file ingestions. The merge of datastreams (corresponding to the file chunks) is no longer done in the server side. Several scripts were adapted accordingly.

This change has impact on the client side ebulk tool: https://lab.nexedi.com/nexedi/ebulk/merge_requests/1/

This MR is a "clone" of previous https://lab.nexedi.com/nexedi/wendelin/merge_requests/40/ due to an issue in the automated tests that required to create a new branch. That MR contains more discussion about these changes.

Passing test results: https://nexedijs.erp5.net/#/test_result_module/20200618-B3C60D56

Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: roque_data_lake_2
GitLab Nexedi Edition | About GitLab | About Nexedi | 沪ICP备2021021310号-2 | 沪ICP备2021021310号-7