I'm starting from a scenario where a PostgreSQL instance is not configured for logical replication and has a table T with X rows. Now, when I'll enable the logical replication, create a replication_slot and a publication for the table T then every change on the table is published and can be consumed. But what about the first X rows existing on the table T before the logical replication starts ? How can I transform these rows in events that can be consumed by the subscribers ? Or how can I import these rows before the logical replication starts ?
PostgreSQL logical replication - Copy of the initial data
447 Views Asked by lordav At
2
There are 2 best solutions below
Related Questions in DATABASE
- How to add the dynamic new rows from my registration form in my database?
- How to store a date/time in sqlite (or something similar to a date)
- Problem with add new attribute in table with BOTO3 on python
- When an E-R attribute should be perceived as a relationship attribute or as an entity set attribute?
- SQLAlchemy: efficient relationship loading in 3-way many-to-many relationship
- Cannot connect to Postgres Database when running Quarkus Tests with Gitlab ci
- Local or remote database with react-native?
- I want to edit a specific row in database
- How to enter data in mongodb array at specific position such that if there is only 2 data in array and I want to insert at 5, then rest data is null
- Open Web Library
- database login.py and register.py error showing 404 file not found and doesn't work
- SQL71561: SqlComputedColumn: When column selected
- Liquibase as SaaS To Configure Multiple Database as Dynamic
- Updated max input vars but table still shows error
- Spring does not map set of roles
Related Questions in POSTGRESQL
- Only the first SQL script gets executed inside Docker Postgres container
- Compare fields in two tables
- Hibernate ClobJdbcType bindings: what are the diferences?
- Postgres && statement Error in Mybatis Mapper?
- Can this query be optimized? (Choosing a random row to insert, that excludes previously inserted Rows)
- Connection terminated unexpectedly while performing multi row insert using pg-promise
- Processing multiple forms in nodejs and postgresql
- How to copy data from SQLite to postgreSQL?
- PGAdmin4 configured behind a reverse proxy but unable to connect to Postgresql server
- Updates to pgsodium encrypted values don't use specified key_id
- Connecting to Postgres running in a Docker container using psql
- Can't connect to local postgresql server from my docker container
- Django Arrayfield migration to cloud sql (Postgresql) not creating the column
- Get list of matching keywords for each post
- docker-compose can't reset postgresql database
Related Questions in WAL
- AWS RDS PostgreSQL: How to adjust wal_level from 'replica' to 'minimal'?
- Postgres connection failed while Debezium connector streaming changes
- PostgreSQL writes several trancations into loop as one transaction with subtransactions
- PostgreSQL: How and Why does the WAL (Write-Ahead Log) Grow?
- How does Write Ahead Logs work in conjunction with inserting with STDIN CSV in Postgres?
- Postgresql 14 Logical Replication
- Why flag "begin" in leveldb WAL is defined as ptr == slice.data()?
- Why isn't it possible to disable archive mode in CloudNativePG PostgreSQL operator in kubernetes?
- How to change wal_level to logical in postgresql database when configured via Helm charts
- Is there a limit regarding the number of files that are stored in the pg_wal directory?
- WAL getting full on db using pg_restore in postgres
- wal streaming and logical replication slot: offset of stream
- In WAL mode, does SQLite re-evaluate the WHERE-clause whenever another transaction commits first?
- where can I find the documentation for the output format of pg_waldump?
- what tables and how many rows are affected by the actions in a single wal file
Related Questions in LOGICAL-REPLICATION
- Behavior of AWS RDS Postgres Logical Replication Slots After Failover
- Trying to create a filtered logical replication on postgresql but the whole table gets replicated
- Is there way to calculate or query 'finish_lsn' of failing logical subscription in Postgres
- Snapshots in Logical Decoding
- Regarding xmin of logical slot
- PostgreSQL replication of data between schemas within same db
- logical_decoding_work_mem and max_logical_worker_processes tunning
- Switching Postgresql Logical Replication Slave to new Master without re-sync
- GCP Datastream doesn't replicate new tables from RDS Postgres
- How many logical replication connecttions will I have?
- Is a primary key necessary to replicate inserts only using Postgres built-in logical replication?
- Postgresql 14 Logical Replication
- Resuming DMS task fails post Source database engine version upgradation
- Postgres logical replication data synchronization step progressing very slowly for large table
- Trigger to Count Number of Logical Replication Tables Changes
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
If you are not using CREATE SUBSCRIPTION, then you will need to handle the initial snapshot for yourself. Either query all the existing data, or start replication on an empty table and copy the existing data into that table from someplace else.
I think that using 'pgoutput' but not using CREATE SUBSCRIPTION is a bit suspect. They were designed to work together. There are other decoding plugins, maybe one of them would be better suited for being used by a "typescript client"?