On the Azure cloud platform, Azure Data Factory is the go-to service for building data pipelines. ETL frameworks like SSIS come ready with controls that support invoking of external APIs. These APIs can be invoked from data pipelines for the desired purpose of processing data. Generally, as a standard mechanism, 3 rd party systems expose their data or business process as a service i.e. But when it comes to integrating or processing data from an external data source, often there is a need to use standard or 3 rd party data processing logic or use data from 3 rd party sources for referential purposes. APIs allow applications to extend and reuse business logic, data, and processes in the form of service.ĭata pipelines which are also known in general terms as Extract Transform Load mechanism, often process data using in-house custom-built logic. They have their own e-commerce portal, but they also offer the usage of their APIs using which subscriber of these APIs can build their own custom applications as well. For example, all the major popular e-commerce applications of the likes of Amazon, Walmart, and others offer their services in the form of APIs. These components generally fall in the category of microservices and Application Programming Interfaces also known as APIs. In this article, we will learn how to invoke an API and process the data returned by the API using Azure Data Factory.Īpplications typically host business logic in granular components to service a variety of internal and external needs.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |