Talend Cloud & AMC Web UI: Hybrid approach

What is AMC? fadeInDown Talend Activity Monitoring Console is an add-on tool integrated into Talend Studio and Talend Administration Center for monitoring Talend Jobs and projects. It helps Talend product administrators or users to achieve enhanced resource management and improved process performance through a convenient graphical interface and a supervising tool. It provides detailed monitoring capabilities that can be used to consolidate the collected activity monitoring information, understands the underlying component and Job interaction, prevents faults that could be unexpectedly generated, and supports system management decisions.

In general, the functionalities are:

  • Batch process monitoring
  • Log information about each execution of a DI Job
  • Jobs can automatically write information to the AMC DB or File
  • TAC and Studio can access information within the AMC DB or File through the Activity Monitoring Console GUI

The Talend Activity Monitoring Console interface consists of the following views:

  • Jobs view
  • History and Detailed history views
  • Meter log view
  • Main chart view
  • Job Volume view
  • Logged Events view
  • Error report view
  • Threshold Charts view

This article is intended for Talend Cloud customers who want to leverage the AMC web UI to monitor Talend Jobs. As many existing Talend on-prem customers are used to the AMC Web UI, with more customers migrating to Talend Cloud we can take a hybrid approach by using an amc.war file from the Talend on-prem version to host AMC as a standalone tool.

It is recommended to use custom dashboards on top of an AMC Database if you are looking for more advanced or custom metrics than that are offered by the AMC web UI.[/vc_column_text][/vc_column_inner][/vc_row_inner][vc_row_inner lg_spacing=”padding_top:20″][vc_column_inner][vc_column_text]

Steps to host AMC as a Standalone Tool on Apache Tomcat

  1. Install the Apache Tomcat Service.
  2. Contact Talend for access, and download the amc.war file.
  3. Place the amc.war file under the tomcat Install Dir/webapps folder.
  4. Restart the Tomcat service.
  5. Once Tomcat is started, create a folder under the webapps directory named amc.
  6. Download the Database JAR file that we want to host to store AMC Data.
  7. Place that JAR under tomcat Install Dir/webapps/amc/WEB-INF/plugins/org.talend.amc.libraries_7.3.1.20190624_1017/lib/ext.
  8. Restart Tomcat.
  9. Navigate to the URL http://ip:port/amc/rap?startup=amc, for example http://localhost:8080/amc/rap?startup=amc as shown in the screenshot below.This should take us to the AMC web page.

 

Conclusion

The AMC Web UI from Talend is plug and play to monitor Talend Jobs. Many on-premises customers have the leverage of accessing the AMC web UI; hosting AMC as a standalone tool with Talend Cloud as a kind of hybrid approach gives the same web UI for cloud customers in line with on-prem customers.

For more information, reach out to us at: solutions@thinkartha.comAuthor: Madhav Nalla

This article also published on Talend Community:
Source: https://community.talend.com/s/article/Talend-Cloud-AMC-Web-UI-Hybrid-approach-jJdLO 

Talend Studio Best Practices – Increase Studio Performance and Settings

Lets discuss about Talend Studio best practices, Issues/Fixes/Recommendation’s at studio level.

Increase Talend Studio memory :
Increase your Talend studio memory – Go to Talend Installed directory and change xms and xmx values based on your system memory. Ini file name should be Talend-Studio-win-x86_64.

If you are using Talend Cloud #TalendCloud #TalendReferenceProject
Setup Reference Project from Talend Studio – Feature is no more available in Talend TAC

Notice: Reference projects now managed in Studio. Read Release Notes how to migrate. If you want to remove reference – use DeleteProjectReference operation in MetaServlet.
Go to File -> Project Settings -> Click on Reference projects -> Added new reference -> Select project and add corresponding branch and click +.
Note : Don’t forget to click on + symbol.[/vc_column_text][/vc_column_inner][/vc_row_inner][vc_row_inner][vc_column_inner][vc_single_image image=”10303″ img_size=”full” alignment=”center”][/vc_column_inner][/vc_row_inner][vc_row_inner][vc_column_inner][vc_column_text]How to Change GroupId in Talend studio

• The default Group Id in Talend studio is org.example.projectname
• You need to change to com.arthasolutions. Talend – To do these changes you need to go file -> project settings -> Build -> Deployment groupid[/vc_column_text][vc_column_text]Publish Snapshot or Releases
In order to deploy a snapshot – Open Talend Studio – Open Talend Job
• Go to Job Tab and navigate to Deployment Tab -> Select the check box Use Snapshot[/vc_column_text][vc_column_text]How to make sure your Talend studio pointing to right snapshot or releases ?

Go to Talend Studio -> window -> Perferences -> Talend -> Artifact Repository -> Repository Settings
• Now check your repository settings tab
• You should see all the repository settings pre-populated.
• Now in 7.2.1 All these settings come from TAC itself.
• If you ever want to change these default settings, you need to click on Use Customized Settings and type the following default release repo and default snapshot repo.

Install all Additional Packages – Talend studio

The code of method (Map<String,Object>) is exceeding the 65535 bytes limit

• In Talend 7.2.1, some Jobs may fail in code compilation with an error of “65535 byte code”. This may happen in some specific Job designs where the code generation is already at the 65 KB limit.
• You can prevent this error by the following parameter to the config.ini file located in the configuration folder under your Talend Studio installation directory:
deactivate_extended_component_

This article is published on Talend Community:
https://community.talend.com/s/feed/0D53p00007vCnuMCAS[/vc_column_text][/vc_column_inner][/vc_row_inner][/vc_column][/vc_row]

Fastest MDM Rollout

Introduction

Carhartt Inc., a prominent clothing and sporting goods company, has been into manufacturing and supplying of work wear apparels since 1889. They have been growing over the years and with time have embraced various channels to sell their products. To this end, various underlying IT systems were built catering to each of the sales channels. With this in place, they have an assortment of systems like AS400, SAP & cloud SAS applications like Cloud twist and simple excel files. While the growth and sales from multiple channels did help them diversify their revenue and gain global reach, the company was facing various challenges in terms of operational inefficiency, poor customer support, bloated marketing expenses, minimal analytics, and non-uniform customer experience.

Thus, what was the best way for Carhartt to do so? The best solution was to shift from a multi-channel approach to an Omni channel retail experience. In response to these challenges, Carhartt reached out to Talend to implement a Master Data Management (MDM) to create a rich and satisfying shopping experience across all channels, as well as gain greater control over master data assets. Talend’s implementation partner, Artha Solutions, focused on Carhartt’s data integration and complete data management. It provided Carhartt a 360° view and delivered high data accuracy for operational transactions and analytical reporting. From requirements to implementation, Artha Solutions successfully implemented the complex MDM solution in 4 months flat! This is something that is unheard of in the MDM world. The telling benefit of the complex central rules implemented by Artha was when data of over 4 million customers were brought on to the MDM platform, a total of 50,000 duplicate customers were identified and removed from the system in the first 6 hours itself.]While multi-channel e-commerce and retail line up perfectly with how customers already shop, adopting an internal multi-channel approach could be disastrous:

  • Difficult for data management and analysis
  • Difficult to differentiate each marketing channel
  • Does not put focus on creating a consistent shopping experience
  • Unavailability of real time data
  • Unable to apply common rules on data due to lack of central data

Omni Channel Experience

Important data or information keeps piling up over time, which becomes redundant and needs to be managed. However, when the point of heightened redundancy is reached, businesses start to suffer from operational and efficiency challenges. This leads to a dire need for data accuracy, coherence, accessibility, and uniqueness. Searchable storage becomes very crucial for all types of businesses, highlighting the significance and criticality of master data management.

  • Single source of truth
  • Improving sale
  • Better data collection
  • Enhanced productivity

MDM Implementation Team

Businesses today struggle to become agile by implementing information systems that support and facilitate changing business requirements. As a result, the management of information about products, customers, etc. has become increasingly important.Additionally, business organizations have systems in place to store and retrieve this data. However, many disparate systems store information, which leads to overlapping, redundant, and inconsistent data. So, where do users go to get valid, accurate, consistent data?

Master Data Management! However, the effectiveness of an MDM solution is as good as the team that is implementing. MDM implementation encompasses wide areas of expertise to do activities such as Talend DI, DQ, Talend MDM, and Talend Data Prep. Master data management (MDM) is critical to achieving effective information governance. Failure to accurately manage information has been the root cause of several incidents, including the leak of sensitive information.

Why is Master Data Management Important?

  • Allows smooth functioning of the organization
  • Derives meaning out of assembled data
  • Improves operations and efficiency
  • Reduces process errors by consolidating and controlling data
  • Removes duplications
  • Avoids missed opportunities and dissatisfied customers
  • Data consistency