Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initialize Tinybird for Insights #2803

Open
wants to merge 79 commits into
base: main
Choose a base branch
from
Open

Initialize Tinybird for Insights #2803

wants to merge 79 commits into from

Conversation

epipav
Copy link
Collaborator

@epipav epipav commented Feb 10, 2025 •
edited
Loading

Changes proposed ✍️

What

copilot:summary
​
copilot:poem

Why

How

copilot:walkthrough

Checklist ✅

  • Label appropriately with Feature, Improvement, or Bug.
  • Add screenshots to the PR description for relevant FE changes
  • New backend functionality has been unit-tested.
  • API documentation has been updated (if necessary) (see docs on API documentation).
  • Quality standards are met.

epipav added 29 commits January 24, 2025 09:31
@epipav
migration for creating activityRelations and getting historical data in
075f58b
@epipav
creating activityRelation rows on integrations
5705be3
@epipav
add missing fields to activityRelations
f24b762
@epipav
move activity relations on entity merge/unmerges
5160443
@epipav
Merge branch 'main' into feature/managing-activity-relations-in-a-sep…
bf10454 
…arate-table
@epipav
fix activity overrides when no rows are returned from queries
1a62f1b
@epipav
Merge branch 'bugfix/data-sink-activity-overrides-fix' into feature/m…
7b3b2df 
…anaging-activity-relations-in-a-separate-table
@epipav
fix fk
3074852
@epipav
add segmentId to activityRelations
a1925da
@epipav
managing activity relations in the profiles worker
25e7b47
@epipav
Merge branch 'main' into feature/managing-activity-relations-in-a-sep…
8c9298b 
…arate-table
@epipav
fix missing segmentId in sql
4241313
@epipav
Merge branch 'main' into feature/managing-activity-relations-in-a-sep…
62bc9d2 
…arate-table
@epipav
affiliation overrides improvements, some fixing with activityRelation…
39946ae 
… moving
@epipav
getting activity data to tinybird with kafka-connect http sink
601f6c8
@epipav
Merge branch 'main' into feature/activity-event-data-to-tinybird
6d2a7e6
@epipav
copying activities from questdb to tinybird via script executor
449a5d1
@epipav
enable going through all activities
e9f6ec5
@epipav
remove console logs
2057104
@epipav
Merge branch 'main' into feature/managing-activity-relations-in-a-sep…
d585202 
…arate-table
@epipav
cleaning
357ad55
@epipav
add tinybird activity_events.datasource to lib/tinybird for reference
07e974d
@epipav
increase batch size to 1000 for activity ingestion to tinybird
4c1df33
@epipav
parametrized batch size
1ee34ab
@epipav
cli functions for tinybird migrations and tb cli usage, scaffold for …
8d21776 
…tinybird project
@epipav
bit cli formatting, improving activities datasource
d7c76b6
@epipav
improve tinybird retries
cd4868c
@epipav
Merge branch 'feature/activity-event-data-to-tinybird' into feature/i…
f63826b 
…nitialize-tinybird-for-insights
@epipav
Merge branch 'feature/managing-activity-relations-in-a-separate-table…
1654c75 
…' into feature/initialize-tinybird-for-insights
@epipav epipav self-assigned this Feb 10, 2025
epipav added 15 commits February 27, 2025 14:57
@epipav
collections datasources for tinybird, removing redundant pipes
905ca45
@epipav
configurable queue suffixes
b965596
@epipav
Merge branch 'main' into feature/initialize-tinybird-for-insights
3e971a2
@epipav
Merge branch 'main' into feature/initialize-tinybird-for-insights
ec63ba5
@epipav
check kafka-connect plugins contents as well before deciding to download
b8ce814
@epipav
add unique slug fields to collections and insightsProjects
8f26d87
@epipav
add slug to tinybird datasources for collections and insightsProjects
c0e5f6c
@epipav
new datasource for repositories - new pipes for search, project list/…
60e4a23 
…detail, collections list/detail
@epipav
add avatar as a denormalized field to members datasource
a58c704
@epipav
improve members and activities datasources
0233631
@epipav
new pipes or widgets, added denormalized country to members datasource
942ea80
@epipav
support copyActivitiesFromQuestdbToTinybird workflow run against few …
85a7b88 
…segments
@epipav
sending segmentIds from schedule to also test the retries
583b495
@epipav
add schedule function to main in script executor
8748936
@epipav
existing pipe updates, retention pipes introduced
0a9b150
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@borfast borfast Awaiting requested review from borfast borfast is a code owner

@themarolt themarolt Awaiting requested review from themarolt themarolt is a code owner

@skwowet skwowet Awaiting requested review from skwowet

@joanreyero joanreyero Awaiting requested review from joanreyero

@sausage-todd sausage-todd Awaiting requested review from sausage-todd sausage-todd is a code owner

Assignees

@borfast borfast

@epipav epipav

Labels
Feature Created by Linear-GitHub Sync
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@epipav @borfast