Re: How to Perform stateless restarts with checkpointing enabled (Apache Users)

Re: How to Perform stateless restarts with checkpointing enabled

Date Prev

Date Next

Thread Prev

Thread Next

Date Index

Thread Index

To: users@xxxxxxxxxxxxxxxx

Subject: Re: How to Perform stateless restarts with checkpointing enabled

From: Kartikey Pant <kartikeypant.eng@xxxxxxxxx>

Date: Thu, 9 May 2024 15:08:30 +0530

In-reply-to: <CANwgZF09Z4hjgGCeD=riwJpZqBgRCfKa0fw3xQ5_-pYbfWTjqQ@mail.gmail.com>

Reply-to: users@xxxxxxxxxxxxxxxx

Please ignore this thread, I wanted to post this to a different Apache mailing list. Apologies.

On Thu, May 9, 2024 at 2:49 PM Kartikey Pant <kartikeypant.eng@xxxxxxxxx> wrote:

We have a source/sink mechanism which uses checkpoints for persistence and can operate in a minor data loss scenario. Is there a method to use checkpoints (to enable use of those source/sink operators) while disabling stateful recovery during restarts?

Our setup uses Flink 1.16.1 alongside Flink Kubernetes Operator 1.5.0. We are also using stateless upgrades with the operator but while the job is restarting, it's still restoring from the last stable checkpoint. Is there any option in Flink or Flink Kubernetes Operator which could help us in this?