Real-Time Data Synchronisation Across Semarchy xDM Models

The Challenge

The client required a cost-effective solution to synchronise data across multiple Semarchy xDM data models without relying on external ETL tools or database functions. Key challenges included ensuring near real-time synchronisation, minimising latency, and maintaining operational efficiency.

Key Issues:

• High costs and complexities associated with external ETL tools.

• Performance delays during data synchronisation.

• The need for seamless, near real-time updates across data models.

The Solution

Wiz Digital Services implemented a custom Java-based solution to enable real-time data synchronisation across Semarchy xDM data models, eliminating the need for third-party tools. This approach ensured optimal performance and reduced operational dependencies.

Key Actions:

1. Built source and target data models in Semarchy xDM to act as publishers and consumers.

2. Designed a Java WAR file to route data changes from the source model to the target model.

3. Configured data notifications and continuous loads to facilitate seamless synchronisation.

4. Ensured delta updates by applying filters (e.g., BatchID) for publishing changes.

5. Integrated APIs and generated API keys for secure data transmission.

6. Deployed and tested the synchronisation process using Semarchy’s application interface and monitoring tools.

The Results

The solution successfully streamlined data synchronisation processes, ensuring efficient and near real-time updates across Semarchy xDM models.

Key Outcomes:

• Cost Savings: Eliminated reliance on external ETL tools, reducing operational costs.

• Real-Time Performance: Achieved near-instantaneous data synchronisation between source and target models.

• Improved Efficiency: Automated data updates with minimal manual intervention.

• Enhanced Scalability: Designed a robust framework ready for multi-model synchronisation.

Key Highlights

• Developed a Java WAR file to act as a seamless router for data synchronisation.

• Configured continuous loads and data notifications to ensure real-time updates.

• Supported multiple entities and models with customisable configurations.

• Verified synchronisation success via Semarchy’s management and monitoring tools.

Why Choose Wiz Digital Services?

Our expertise in data synchronisation and custom integrations ensures cost-effective, scalable, and high-performance solutions tailored to your needs. By leveraging platforms like Semarchy xDM and innovative Java-based frameworks, we deliver measurable results with precision.