Migrate for Embulk v0.1x #5
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
t3t5u
commented
Dec 9, 2024
•
t3t5u
commented
- expand_json_on_guess: false
- expand_json_on_guess: true
- Difference with origin (treasure-data)
…radle-plugin Apply Embulk Gradle plugin and upgrade Gradle wrapper
This is necessary to be compatible with Embulk v0.10.*
…-version Upgrade Embulk to v0.10.19
…o-0.2.11 Bump version to 0.2.11
Performs source code scan.
…_embulk_v0_10 Modernized with Embulk v0.10.28 styles
…c_schema Support dynamic schema when ingesting data
…_graceful_exit Graceful shutdown in case no records for dynamic schema
…-v0.10.32 Catchup with embulk 0.10.32
…en-central-0.3.0 Release to Maven Central in v0.3.0, under the Apache License 2.0
Remove Travis CI configuration
…bot-update Update CodeQL actions to v2 and enable Dependabot for GitHub Actions
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](actions/checkout@v2...v3) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
…hub_actions/actions/checkout-3 Bump actions/checkout from 2 to 3
Update Embulk Version To 0.10.32 And Add Github Action To Check Commit
Update plugin version
…/upload-artifact Update upload artifact to v4
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 3 to 4. - [Release notes](https://github.com/actions/setup-java/releases) - [Commits](actions/setup-java@v3...v4) --- updated-dependencies: - dependency-name: actions/setup-java dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
…hub_actions/actions/setup-java-4 Bump actions/setup-java from 3 to 4
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](actions/checkout@v3...v4) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
…hub_actions/actions/checkout-4 Bump actions/checkout from 3 to 4
expand_json_on_guess: falseconfig.yml$ cat config.15447.yml
exec:
max_threads: 1
min_output_tasks: 1
in:
type: jira
username: dev@trocco.io
password: ***
uri: https://primenumber-dev.atlassian.net
jql: project IS NOT EMPTY
expand: []
expand_json_on_guess: false
retry_initial_wait_sec: 1
retry_limit: 5
max_results: 50
columns:
- name: aggregateprogress
type: json
- name: aggregatetimeestimate
type: string
- name: aggregatetimeoriginalestimate
type: string
- name: aggregatetimespent
type: string
- name: assignee
type: string
- name: attachment
type: json
- name: comment
type: json
- name: components
type: json
- name: created
type: timestamp
format: "%Y-%m-%dT%H:%M:%S.%L%z"
- name: creator
type: json
- name: customfield_10000
type: json
- name: customfield_10001
type: string
- name: customfield_10002
type: string
- name: customfield_10003
type: string
- name: customfield_10004
type: string
- name: customfield_10005
type: string
- name: customfield_10006
type: string
- name: customfield_10007
type: string
- name: customfield_10008
type: string
- name: customfield_10009
type: string
- name: customfield_10010
type: string
- name: customfield_10014
type: string
- name: customfield_10015
type: string
- name: customfield_10016
type: string
- name: customfield_10017
type: string
- name: customfield_10018
type: json
- name: customfield_10019
type: string
- name: customfield_10020
type: string
- name: customfield_10021
type: string
- name: customfield_10022
type: string
- name: customfield_10023
type: string
- name: customfield_10024
type: string
- name: customfield_10025
type: string
- name: description
type: string
- name: duedate
type: string
- name: environment
type: string
- name: expand
type: string
- name: fixVersions
type: json
- name: id
type: long
- name: issuelinks
type: json
- name: issuerestriction
type: json
- name: issuetype
type: json
- name: key
type: string
- name: labels
type: json
- name: lastViewed
type: string
- name: priority
type: json
- name: progress
type: json
- name: project
type: json
- name: reporter
type: json
- name: resolution
type: string
- name: resolutiondate
type: string
- name: security
type: string
- name: self
type: string
- name: status
type: json
- name: statuscategorychangedate
type: timestamp
format: "%Y-%m-%dT%H:%M:%S.%L%z"
- name: subtasks
type: json
- name: summary
type: string
- name: timeestimate
type: string
- name: timeoriginalestimate
type: string
- name: timespent
type: string
- name: timetracking
type: json
- name: updated
type: timestamp
format: "%Y-%m-%dT%H:%M:%S.%L%z"
- name: versions
type: json
- name: votes
type: json
- name: watches
type: json
- name: worklog
type: json
- name: workratio
type: long
out:
type: command
command: cat -
formatter:
type: jsonlembulk run config.ymlembulk guessguessed.yml$ cat guessed.15447.yml
exec: {max_threads: 1, min_output_tasks: 1}
in:
type: jira
username: dev@trocco.io
password: ***
uri: https://primenumber-dev.atlassian.net
jql: project IS NOT EMPTY
expand: []
expand_json_on_guess: false
retry_initial_wait_sec: 1
retry_limit: 5
max_results: 50
columns:
- {name: aggregateprogress, type: json}
- {name: aggregatetimeestimate, type: json}
- {name: aggregatetimeoriginalestimate, type: json}
- {name: aggregatetimespent, type: json}
- {name: assignee, type: json}
- {name: attachment, type: json}
- {name: comment, type: json}
- {name: components, type: json}
- {name: created, type: timestamp, format: '%Y-%m-%dT%H:%M:%S.%L%z'}
- {name: creator, type: json}
- {name: customfield_10001, type: json}
- {name: customfield_10002, type: json}
- {name: customfield_10003, type: json}
- {name: customfield_10004, type: json}
- {name: customfield_10005, type: json}
- {name: customfield_10006, type: json}
- {name: customfield_10007, type: json}
- {name: customfield_10008, type: json}
- {name: customfield_10009, type: json}
- {name: customfield_10010, type: json}
- {name: customfield_10014, type: json}
- {name: customfield_10015, type: json}
- {name: customfield_10016, type: json}
- {name: customfield_10017, type: json}
- {name: customfield_10018, type: json}
- {name: customfield_10019, type: string}
- {name: customfield_10020, type: json}
- {name: customfield_10021, type: json}
- {name: customfield_10022, type: json}
- {name: customfield_10023, type: json}
- {name: customfield_10024, type: json}
- {name: customfield_10025, type: json}
- {name: customfield_10029, type: json}
- {name: customfield_10030, type: json}
- {name: customfield_10031, type: json}
- {name: customfield_10032, type: json}
- {name: customfield_10034, type: json}
- {name: customfield_10035, type: json}
- {name: customfield_10036, type: json}
- {name: customfield_10037, type: json}
- {name: customfield_10039, type: json}
- {name: customfield_10040, type: json}
- {name: customfield_10041, type: json}
- {name: customfield_10042, type: json}
- {name: customfield_10043, type: json}
- {name: description, type: json}
- {name: duedate, type: json}
- {name: environment, type: json}
- {name: expand, type: string}
- {name: fixVersions, type: json}
- {name: id, type: long}
- {name: issuelinks, type: json}
- {name: issuerestriction, type: json}
- {name: issuetype, type: json}
- {name: key, type: string}
- {name: labels, type: json}
- {name: lastViewed, type: json}
- {name: priority, type: json}
- {name: progress, type: json}
- {name: project, type: json}
- {name: reporter, type: json}
- {name: resolution, type: json}
- {name: resolutiondate, type: json}
- {name: security, type: json}
- {name: self, type: string}
- {name: status, type: json}
- {name: statuscategorychangedate, type: timestamp, format: '%Y-%m-%dT%H:%M:%S.%L%z'}
- {name: subtasks, type: json}
- {name: summary, type: string}
- {name: timeestimate, type: json}
- {name: timeoriginalestimate, type: json}
- {name: timespent, type: json}
- {name: timetracking, type: json}
- {name: updated, type: timestamp, format: '%Y-%m-%dT%H:%M:%S.%L%z'}
- {name: versions, type: json}
- {name: votes, type: json}
- {name: watches, type: json}
- {name: worklog, type: json}
- {name: workratio, type: long}
out:
type: command
command: cat -
formatter: {type: jsonl}embulk run guessed.yml |
expand_json_on_guess: trueconfig.yml$ cat config.88624.yml
exec:
max_threads: 1
min_output_tasks: 1
in:
type: jira
username: dev@trocco.io
password: ***
uri: https://primenumber-dev.atlassian.net
jql: project IS NOT EMPTY
expand: []
expand_json_on_guess: true
retry_initial_wait_sec: 1
retry_limit: 5
max_results: 50
columns:
- name: aggregateprogress.progress
type: long
- name: aggregateprogress.total
type: long
- name: aggregatetimeestimate
type: string
- name: aggregatetimeoriginalestimate
type: string
- name: aggregatetimespent
type: string
- name: assignee
type: string
- name: attachment
type: string
- name: comment.comments
type: string
- name: comment.maxResults
type: long
- name: comment.self
type: string
- name: comment.startAt
type: long
- name: comment.total
type: long
- name: components
type: string
- name: created
type: timestamp
format: "%Y-%m-%dT%H:%M:%S.%L%z"
- name: creator.accountId
type: string
- name: creator.accountType
type: string
- name: creator.active
type: boolean
- name: creator.avatarUrls.16x16
type: string
- name: creator.avatarUrls.24x24
type: string
- name: creator.avatarUrls.32x32
type: string
- name: creator.avatarUrls.48x48
type: string
- name: creator.displayName
type: string
- name: creator.emailAddress
type: string
- name: creator.self
type: string
- name: creator.timeZone
type: string
- name: customfield_10001
type: string
- name: customfield_10002
type: string
- name: customfield_10003
type: string
- name: customfield_10004
type: string
- name: customfield_10005
type: string
- name: customfield_10006
type: string
- name: customfield_10007
type: string
- name: customfield_10008
type: string
- name: customfield_10009
type: string
- name: customfield_10010
type: string
- name: customfield_10014
type: string
- name: customfield_10015
type: string
- name: customfield_10016
type: string
- name: customfield_10017
type: string
- name: customfield_10018.hasEpicLinkFieldDependency
type: boolean
- name: customfield_10018.nonEditableReason.message
type: string
- name: customfield_10018.nonEditableReason.reason
type: string
- name: customfield_10018.showField
type: boolean
- name: customfield_10019
type: string
- name: customfield_10020
type: string
- name: customfield_10021
type: string
- name: customfield_10022
type: string
- name: customfield_10023
type: string
- name: customfield_10024
type: string
- name: customfield_10025
type: string
- name: customfield_10029
type: string
- name: customfield_10030
type: string
- name: customfield_10031
type: string
- name: customfield_10032
type: string
- name: customfield_10033
type: string
- name: customfield_10034
type: string
- name: description
type: string
- name: duedate
type: string
- name: environment
type: string
- name: expand
type: string
- name: fixVersions
type: string
- name: id
type: long
- name: issuelinks
type: string
- name: issuerestriction.issuerestrictions
type: json
- name: issuerestriction.shouldDisplay
type: boolean
- name: issuetype.avatarId
type: long
- name: issuetype.description
type: string
- name: issuetype.hierarchyLevel
type: long
- name: issuetype.iconUrl
type: string
- name: issuetype.id
type: long
- name: issuetype.name
type: string
- name: issuetype.self
type: string
- name: issuetype.subtask
type: boolean
- name: key
type: string
- name: labels
type: string
- name: lastViewed
type: string
- name: priority.iconUrl
type: string
- name: priority.id
type: long
- name: priority.name
type: string
- name: priority.self
type: string
- name: progress.progress
type: long
- name: progress.total
type: long
- name: project.avatarUrls.16x16
type: string
- name: project.avatarUrls.24x24
type: string
- name: project.avatarUrls.32x32
type: string
- name: project.avatarUrls.48x48
type: string
- name: project.id
type: long
- name: project.key
type: string
- name: project.name
type: string
- name: project.projectTypeKey
type: string
- name: project.self
type: string
- name: project.simplified
type: boolean
- name: reporter.accountId
type: string
- name: reporter.accountType
type: string
- name: reporter.active
type: boolean
- name: reporter.avatarUrls.16x16
type: string
- name: reporter.avatarUrls.24x24
type: string
- name: reporter.avatarUrls.32x32
type: string
- name: reporter.avatarUrls.48x48
type: string
- name: reporter.displayName
type: string
- name: reporter.emailAddress
type: string
- name: reporter.self
type: string
- name: reporter.timeZone
type: string
- name: resolution
type: string
- name: resolutiondate
type: string
- name: security
type: string
- name: self
type: string
- name: status.description
type: string
- name: status.iconUrl
type: string
- name: status.id
type: long
- name: status.name
type: string
- name: status.self
type: string
- name: status.statusCategory.colorName
type: string
- name: status.statusCategory.id
type: long
- name: status.statusCategory.key
type: string
- name: status.statusCategory.name
type: string
- name: status.statusCategory.self
type: string
- name: statuscategorychangedate
type: timestamp
format: "%Y-%m-%dT%H:%M:%S.%L%z"
- name: subtasks
type: string
- name: summary
type: string
- name: timeestimate
type: string
- name: timeoriginalestimate
type: string
- name: timespent
type: string
- name: timetracking
type: json
- name: updated
type: timestamp
format: "%Y-%m-%dT%H:%M:%S.%L%z"
- name: versions
type: string
- name: votes.hasVoted
type: boolean
- name: votes.self
type: string
- name: votes.votes
type: long
- name: watches.isWatching
type: boolean
- name: watches.self
type: string
- name: watches.watchCount
type: long
- name: worklog.maxResults
type: long
- name: worklog.startAt
type: long
- name: worklog.total
type: long
- name: worklog.worklogs
type: string
- name: workratio
type: long
out:
type: command
command: cat -
formatter:
type: jsonlembulk run config.ymlembulk guessguessed.yml$ cat guessed.88624.yml
exec: {max_threads: 1, min_output_tasks: 1}
in:
type: jira
username: dev@trocco.io
password: ***
uri: https://primenumber-dev.atlassian.net
jql: project IS NOT EMPTY
expand: []
expand_json_on_guess: true
retry_initial_wait_sec: 1
retry_limit: 5
max_results: 50
columns:
- {name: aggregateprogress.progress, type: long}
- {name: aggregateprogress.total, type: long}
- {name: aggregatetimeestimate, type: json}
- {name: aggregatetimeoriginalestimate, type: json}
- {name: aggregatetimespent, type: json}
- {name: assignee, type: json}
- {name: attachment, type: string}
- {name: comment.comments, type: string}
- {name: comment.maxResults, type: long}
- {name: comment.self, type: string}
- {name: comment.startAt, type: long}
- {name: comment.total, type: long}
- {name: components, type: string}
- {name: created, type: timestamp, format: '%Y-%m-%dT%H:%M:%S.%L%z'}
- {name: creator.accountId, type: string}
- {name: creator.accountType, type: string}
- {name: creator.active, type: boolean}
- {name: creator.avatarUrls.16x16, type: string}
- {name: creator.avatarUrls.24x24, type: string}
- {name: creator.avatarUrls.32x32, type: string}
- {name: creator.avatarUrls.48x48, type: string}
- {name: creator.displayName, type: string}
- {name: creator.emailAddress, type: string}
- {name: creator.self, type: string}
- {name: creator.timeZone, type: string}
- {name: customfield_10001, type: json}
- {name: customfield_10002, type: string}
- {name: customfield_10003, type: json}
- {name: customfield_10004, type: json}
- {name: customfield_10005, type: json}
- {name: customfield_10006, type: json}
- {name: customfield_10007, type: json}
- {name: customfield_10008, type: json}
- {name: customfield_10009, type: json}
- {name: customfield_10010, type: json}
- {name: customfield_10014, type: json}
- {name: customfield_10015, type: json}
- {name: customfield_10016, type: json}
- {name: customfield_10017, type: json}
- {name: customfield_10018.hasEpicLinkFieldDependency, type: boolean}
- {name: customfield_10018.nonEditableReason.message, type: string}
- {name: customfield_10018.nonEditableReason.reason, type: string}
- {name: customfield_10018.showField, type: boolean}
- {name: customfield_10019, type: string}
- {name: customfield_10020, type: json}
- {name: customfield_10021, type: json}
- {name: customfield_10022, type: json}
- {name: customfield_10023, type: json}
- {name: customfield_10024, type: json}
- {name: customfield_10025, type: json}
- {name: customfield_10029, type: json}
- {name: customfield_10030, type: json}
- {name: customfield_10031, type: json}
- {name: customfield_10032, type: json}
- {name: customfield_10034, type: json}
- {name: customfield_10035, type: json}
- {name: customfield_10036, type: json}
- {name: customfield_10037, type: json}
- {name: customfield_10039, type: json}
- {name: customfield_10040, type: json}
- {name: customfield_10041, type: json}
- {name: customfield_10042, type: json}
- {name: customfield_10043, type: json}
- {name: description, type: json}
- {name: duedate, type: json}
- {name: environment, type: json}
- {name: expand, type: string}
- {name: fixVersions, type: string}
- {name: id, type: long}
- {name: issuelinks, type: string}
- {name: issuerestriction.issuerestrictions, type: json}
- {name: issuerestriction.shouldDisplay, type: boolean}
- {name: issuetype.avatarId, type: long}
- {name: issuetype.description, type: string}
- {name: issuetype.entityId, type: string}
- {name: issuetype.hierarchyLevel, type: long}
- {name: issuetype.iconUrl, type: string}
- {name: issuetype.id, type: long}
- {name: issuetype.name, type: string}
- {name: issuetype.self, type: string}
- {name: issuetype.subtask, type: boolean}
- {name: key, type: string}
- {name: labels, type: string}
- {name: lastViewed, type: json}
- {name: priority.iconUrl, type: string}
- {name: priority.id, type: long}
- {name: priority.name, type: string}
- {name: priority.self, type: string}
- {name: progress.progress, type: long}
- {name: progress.total, type: long}
- {name: project.avatarUrls.16x16, type: string}
- {name: project.avatarUrls.24x24, type: string}
- {name: project.avatarUrls.32x32, type: string}
- {name: project.avatarUrls.48x48, type: string}
- {name: project.id, type: long}
- {name: project.key, type: string}
- {name: project.name, type: string}
- {name: project.projectTypeKey, type: string}
- {name: project.self, type: string}
- {name: project.simplified, type: boolean}
- {name: reporter.accountId, type: string}
- {name: reporter.accountType, type: string}
- {name: reporter.active, type: boolean}
- {name: reporter.avatarUrls.16x16, type: string}
- {name: reporter.avatarUrls.24x24, type: string}
- {name: reporter.avatarUrls.32x32, type: string}
- {name: reporter.avatarUrls.48x48, type: string}
- {name: reporter.displayName, type: string}
- {name: reporter.emailAddress, type: string}
- {name: reporter.self, type: string}
- {name: reporter.timeZone, type: string}
- {name: resolution, type: json}
- {name: resolutiondate, type: json}
- {name: security, type: json}
- {name: self, type: string}
- {name: status.description, type: string}
- {name: status.iconUrl, type: string}
- {name: status.id, type: long}
- {name: status.name, type: string}
- {name: status.self, type: string}
- {name: status.statusCategory.colorName, type: string}
- {name: status.statusCategory.id, type: long}
- {name: status.statusCategory.key, type: string}
- {name: status.statusCategory.name, type: string}
- {name: status.statusCategory.self, type: string}
- {name: statuscategorychangedate, type: timestamp, format: '%Y-%m-%dT%H:%M:%S.%L%z'}
- {name: subtasks, type: string}
- {name: summary, type: string}
- {name: timeestimate, type: json}
- {name: timeoriginalestimate, type: json}
- {name: timespent, type: json}
- {name: timetracking, type: json}
- {name: updated, type: timestamp, format: '%Y-%m-%dT%H:%M:%S.%L%z'}
- {name: versions, type: string}
- {name: votes.hasVoted, type: boolean}
- {name: votes.self, type: string}
- {name: votes.votes, type: long}
- {name: watches.isWatching, type: boolean}
- {name: watches.self, type: string}
- {name: watches.watchCount, type: long}
- {name: worklog.maxResults, type: long}
- {name: worklog.startAt, type: long}
- {name: worklog.total, type: long}
- {name: worklog.worklogs, type: string}
- {name: workratio, type: long}
out:
type: command
command: cat -
formatter: {type: jsonl}embulk run guessed.yml |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.