API Data Integration
(WorldData ADI V9a)
API Data Integration is a system built for the purpose of collecting data from APIs. Those APIs, provided by organizations and units, can be configured to be accessible or inaccessible on the Internet.
When the APIs are public on the Internet, the access to the APIs to get data needs to be authenticated. When the APIs are not public, data collection from the APIs is done by allowing the software to be installed in the same local network as the server that provides the APIs (authentication may be required or not).
After the software is installed, the administrator will configure the connection information to the APIs to perform data collection. The API data integration software will connect to the APIs to retrieve data by periodically configured time:
- Configure interval for data retrieval: That is to configure the interval between consecutive data retrievals. For example, it is possible to configure the connection to the APIs for data retrieval by 30 minutes periodically.
- Configure a specific time for data retrieval: That is to configure the specific time to get data. For example, it is possible to configure data retrieval at the end of the day (23:59 daily), at 12:00 during weekdays.
After receiving data from the APIs, the software will read the data and convert data format before transferring data to the next processes.
1. Connection management
- Manage connections to APIs.
- Configure the frequency of data retrieval from APIs.
- Summarize data during the collection.
- Manage the system to allow users to log in, log out of the system.
2. Managing the API data retrieval
- Processor dragging for the connection to API allows:
+ Displaying the items to be configured for the connection to API.
+ Entering URL of the API for data collection.
+ Entering the API authenticating information if necessary (via Token or Username/Password).
- Data retrieval scheduling allows:
+ Retrieving data by time period.
+ Retrieving data by specific time.
- Configure the reading/converting of data format collected from APIs.
3. Configuring the target of data retrieval
- Configure database as the target (to transfer data collected from APIs into a specific database).
- Configure API as the target (to transfer data collected from API to another API).
4. Displaying configured processes
- Users, administrators can view process initiation time, process modification time.
- Enable turning on and off processes, display processes in progress, processes paused, processes inactive.
- Users, administrators can start the data collection process on the graphic interface, can suspend data collection on the graphic interface.
- Allows users and administrators to easily look up and search for the configured processes.
Model for connection/integration with other systems
Technical solutions used
- Programming language: Java
- Database: MySQL, SQL Server, PostgreSQL
- Operating system: Windows; Ubuntu
- CPU: 8 CPU cores
- Ram: 16GB
- Disk: 500GB
- OS: Ubuntu Server 18.04 x64
To learn about the price, contact us here.