Setup Guide

• Create S3 bucket

• Create Glue database

• Create IAM role with permission
  • AmazonS3FullAccess
  • AWSGlueConsoleFullAccess
  • CloudWatchLogsFullAccess

• Install Maven

apt install maven

Flink jars file: -

• Download via Maven

cd flink_libs
rm -rf jars && mvn dependency:copy-dependencies -DoutputDirectory=jars

• Upload to S3

Flink App: -

• Create app script in flink_app_example\src\main\java\com\example\DummyApp.java
• Build app

cd flink_app_example
mvn clean package -q

• Upload to S3

AWS Flink App

• Create Flink App

• Set jars file via configure > runtime properties

# Set Key = 
pipeline.classpaths

# Set Value =
s3://poc-iceberg-20251123/flink_libs/flink-connector-kafka-3.3.0-1.20.jar;s3://poc-iceberg-20251123/flink_libs/flink-sql-connector-kafka-3.3.0-1.20.jar;s3://poc-iceberg-20251123/flink_libs/flink-json-1.20.0.jar;s3://poc-iceberg-20251123/flink_libs/iceberg-flink-runtime-1.20-1.8.0.jar;s3://poc-iceberg-20251123/flink_libs/iceberg-aws-bundle-1.8.0.jar

• Set Application Code

Run Flink App: -