Talend Integration Suite

Talend Integration Suite's Shared Repository is designed to consolidate all project information and enterprise metadata in a centralized repository shared by all stakeholders in the integration processes: business users, job developers, and IT operations staff-all of whom can access the same, single version of the truth. This shared repository facilitates collaboration between team members by allowing them to store and share their business models, integration jobs, and metadata in an industry-standard source manager (SVN).

This promotes reusability of objects and code, as well as facilitating the design of development best practices that can then be leveraged by all developers.

The Shared Repository features advanced collaboration capabilities that include object-level check-in and check-out, as well as users, roles, permissions & privileges management.

As the architecture of enterprise processes is often complex and takes a long time to implement, Talend Integration Suite includes automation features to facilitate the development and implementation of these processes.

• Numerous wizards help automate connections to heterogeneous sources, including enterprise-scale platforms such as SAP, or the most versatile sources such as Copybook (EBCDIC) formats or Web Services.
• Core models of processes can be developed in Talend Joblets that can be reused to facilitate the industrialization of data integration processes.
• The Reference Projects help avoid duplication (copy-paste) of existing projects. "Slave" projects are linked to a master project by reference and thus help leverage developments and reuse proven processes.
• The parallelization feature helps make the most of enterprise server capabilities and the number of processors available, greatly improving processing time.
• The Change Data Capture (Publish & Subscribe) feature quickly identifies and captures data that has been added to, updated in, or removed from database tables and makes these changes (and only the changes) available to subscribers.
• The Project Audit tool provides qualitative and quantitative metrics calculated against best practices, that help optimize data integration projects.

Talend Integration Suite incorporates powerful capabilities for managing all data integration deployments-from the simplest Jobs to the most complex ones, from single Jobs to thousands of Jobs, and with data volumes ranging from a few records to terabytes of data through a central console, the Talend Administration Center. Based on Web 2.0, including the AJAX technology, the administration center web application offers friendly ergonomics and fast-refresh capability.

• Job Conductor coordinates and schedules the execution of data integration jobs. It provides a centralized execution interface from which all jobs can be started upon request or according to time-based schedules. Job Conductor automatically maps available execution servers and constantly monitors their resources to intelligently load balance the execution of jobs
• Job Conductor Advanced adds event-based scheduling capabilities for real-time integration.
• Grid Conductor optimizes the scalability and availability of the integration processes by ensuring an optimal use of the execution grid, automatically distributing jobs across the grid.
  With dynamic load balancing that constantly monitors the resources available on the execution servers, and an intelligent distribution of jobs, Grid Conductor guarantees that all jobs execute smoothly at all times and fully leverage available resources, removing bottlenecks created by the traditional single-server approach. This alleviates any concerns related to resource preemption when a large number of jobs run concurrently, or when non-dedicated servers are used. Grid Conductor also provides automatic fail-over in the event an execution resource becomes unavailable.
• CPU Balancer provides the highest degree of parallelization for the integration processes. It distributes jobs between all processing resources available, and parallelizes their execution between CPUs and cores. It also provides synchronization and wait points.
• Distant Run enables the remote execution of jobs on specified systems. This can be extremely useful for testing jobs in the same configuration as the production environment, or on different operating systems, or for simply running jobs upon request on specific systems, without going through complex deployment procedures.

Talend Integration Suite provides advanced monitoring capabilities that enable centralized supervision of all integration processes.

• The Activity Monitoring Console monitors job events (successes, failures, warnings, etc.), execution times and data volumes through a single console, which is available as a stand-alone environment or may be fully integrated to Talend Open Studio.
  With customizable indicators and thresholds, the Activity Monitoring Console provides a high-level view that can drill down into individual jobs.
• The Activity Monitoring Dashboard (included in the Talend Administration Center) is a more advanced, Web-based version of the Activity Monitoring Console that can be accessed easily through a Web browser. The Dashboard provides real-time gauges and status indicators, as well as a business-model orientation, enabling business stakeholders to view both the current status and historical data of any job.