Skip to content

Upgrade dependencies in pom.xml #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Upgrade dependencies in pom.xml #2

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
0a287ab
Upgrade dependencies in pom.xml
inoue22 Jul 1, 2024
7ff6dbb
Update pom.xml
inoue22 Jul 2, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 8 additions & 8 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,16 +4,16 @@


</div>


--------
> #### 🚨 August 30, 2023: Amazon Kinesis Data Analytics has been renamed to [Amazon Managed Service for Apache Flink](https://aws.amazon.com/managed-service-apache-flink).

--------
--------
> #### 🚨 August 30, 2023: Amazon Kinesis Data Analytics has been renamed to [Amazon Managed Service for Apache Flink](https://aws.amazon.com/managed-service-apache-flink).
--------


<p>This Kinesis Data Analytics for Apache Flink Application reads from a Kinesis Data Stream, Serializes the records and then writes them to an Aurora Postgres Table (every 100 messages).
<br>
<br>
</p>

## 📝 Table of Contents
Expand All @@ -31,7 +31,7 @@ These instructions will get you a copy of the project up and running on your loc
### Prerequisites

```
- Java 1.8
- Java 11
- Apache Flink
- A Local or Remote Postgres Database
- A Kinesis Data Stream
Expand Down
90 changes: 0 additions & 90 deletions aws-kinesis-analytics-java-apps.iml
View file
Open in desktop

This file was deleted.

34 changes: 17 additions & 17 deletions pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,10 @@
<packaging>jar</packaging>

<properties>
<java.version>1.8</java.version>
<scala.binary.version>2.11</scala.binary.version>
<kda.version>1.1.0</kda.version>
<flink.version>1.8.2</flink.version>
<java.version>11</java.version>
<scala.binary.version>2.12</scala.binary.version>
<kda.version>2.1.0</kda.version>
<flink.version>1.19.1</flink.version>
</properties>

<dependencyManagement>
Expand All @@ -22,7 +22,7 @@
<groupId>com.amazonaws</groupId>
<artifactId>aws-java-sdk-bom</artifactId>
<!-- Get the latest SDK version from https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-bom -->
<version>1.11.688</version>
<version>1.12.754</version>
<type>pom</type>
<scope>import</scope>
</dependency>
Expand All @@ -33,19 +33,19 @@
<dependency>
<groupId>com.amazonaws</groupId>
<artifactId>aws-kinesisanalytics-runtime</artifactId>
<version>${kda.version}</version>
<version>1.2.0</version>
</dependency>


<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kinesis_${scala.binary.version}</artifactId>
<version>${flink.version}</version>
<artifactId>flink-connector-kinesis</artifactId>
<version>4.3.0-1.19</version>
</dependency>

<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java_${scala.binary.version}</artifactId>
<artifactId>flink-streaming-java</artifactId>
<version>${flink.version}</version>
<scope>provided</scope>
</dependency>
Expand All @@ -65,41 +65,41 @@

<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-jdbc_2.11</artifactId>
<version>${flink.version}</version>
<artifactId>flink-jdbc_${scala.binary.version}</artifactId>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Upgrading to Flink 1.19 should replace the obsolete Flink JDBC org.apache.flink:flink-jdbc_2.12:1.10.3 with the new JDBC connector (org.apache.flink:flink-connector-jdbc:3.2.0-1.19) using the new API.

<version>1.10.3</version>
</dependency>

<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-table</artifactId>
<version>1.8.2</version>
<version>${flink.version}</version>
<type>pom</type>
<scope>provided</scope>
</dependency>

<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-table-planner_2.11</artifactId>
<artifactId>flink-table-planner_${scala.binary.version}</artifactId>
<version>${flink.version}</version>
</dependency>

<dependency>
<groupId>postgresql</groupId>
<groupId>org.postgresql</groupId>
<artifactId>postgresql</artifactId>
<version>9.1-901-1.jdbc4</version>
<version>42.7.3</version>
</dependency>


<!-- For flink web UI you need these -->
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients_2.11</artifactId>
<artifactId>flink-clients</artifactId>
<version>${flink.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-runtime-web_2.11</artifactId>
<artifactId>flink-runtime-web</artifactId>
<version>${flink.version}</version>
<scope>provided</scope>
</dependency>
Expand Down