Getting error with Springboot 3.4.1 while executing batch jobs

[SangaviThangavel]

Bug description
Getting error with Springboot 3.4.1 while executing batch jobs

Error Message:
Command failed with error 251 (NoSuchTransaction): 'Transaction with { txnNumber: 24 } has been aborted.' on server pl-0-eu-west-1.3dhx9.mongodb.net:1041. The full response is {"errorLabels": ["TransientTransactionError"], "ok": 0.0, "errmsg": "Transaction with { txnNumber: 24 } has been aborted.", "code": 251, "codeName": "NoSuchTransaction", "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1735790456, "i": 1}}, "signature": {"hash": {"$binary": {"base64": "sKYXYVX+BZTVEOMUocGi7Cm8t2A=", "subType": "00"}}, "keyId": 7434572047025438725}}, "operationTime": {"$timestamp": {"t": 1735790456, "i": 1}}}

Possible Cause: The error might be due to the transaction timeout or multiple write operations causing the transaction to abort.

Reference: TransientTransactionError/NoSuchTransaction issue on long/large write operations using Mongoose transactions

Environment

• Spring Batch version: 5.2.0
• Java version: 21
• Database: Mongo Atlas

Steps to reproduce

1. Execute the batch job.
2. The job should sync all data.
3. The job aborts in between, possibly due to multiple write operations.

Expected behavior
The batch job should execute and sync all data without aborting.

Minimal Complete Reproducible example
Fails at: mongoTemplate.findAndModify(query, update, SelectorModel.class, CollectionNames.SELECTORS);

[fmbenhassine]

Thank you for opening this issue. However, this is not enough for us to reproduce it. Please upload the code to run to reproduce the error. You can start with this project template. We also have docker-based integration test for MongoDB that you can use to provide a failing test.

Thank you upfront.

[kamel1239]

Hi @fmbenhassine I'm having a similar issue with findAndModify on BATCH_SEQUENCES:

Exception message: Command failed with error 112 (WriteConflict): 'Caused by :: Write conflict during plan execution, and yielding is disabled. :: Please retry your operation or multi-document transaction.'. The full response is {"errorLabels": ["TransientTransactionError"], "ok": 0.0, "errmsg": "Caused by :: Write conflict during plan execution, and yielding is disabled. :: Please retry your operation or multi-document transaction.", "code": 112, "codeName": "WriteConflict", "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1741091658, "i": 90}}, "signature": {"hash": {"$binary": {"base64": "syQVyb57PxBWu3BfpYK5ciTQodU=", "subType": "00"}}, "keyId": 7433756372606386178}}, "operationTime": {"$timestamp": {"t": 1741091658, "i": 90}}}

My job launcher configuration:

@Override
@Bean
public JobLauncher jobLauncher(JobRepository jobRepository) {
    var jobLauncher = new TaskExecutorJobLauncher();
    jobLauncher.setJobRepository(jobRepository);
    jobLauncher.setTaskExecutor(new VirtualThreadTaskExecutor("spring-batch-"));
    return jobLauncher;
}

My job repository configuration:

--> MongoConfig.java
 @Bean
    public MongoTransactionManager transactionManager() {
        return new MongoTransactionManager(mongoDbFactory());
    }

--> BatchConfig.java
@Bean
public JobRepository jobRepository(MongoTemplate mongoTemplate,
    MongoTransactionManager transactionManager) throws Exception {
    var jobRepositoryFactoryBean = new MongoJobRepositoryFactoryBean();
    jobRepositoryFactoryBean.setMongoOperations(mongoTemplate);
    jobRepositoryFactoryBean.setTransactionManager(transactionManager);
    jobRepositoryFactoryBean.afterPropertiesSet();
    return jobRepositoryFactoryBean.getObject();
}

The jobLauncher will be called through an HTTP endpoint and will run a simple job (read an http flux and save elements in mongo). If I spam the HTTP call, I get this error.

StackTrace:

[com.mongodb.internal.connection.ProtocolHelper, com.mongodb.internal.connection.InternalStreamConnection, com.mongodb.internal.connection.InternalStreamConnection, com.mongodb.internal.connection.InternalStreamConnection, com.mongodb.internal.connection.InternalStreamConnection, com.mongodb.internal.connection.UsageTrackingInternalConnection, com.mongodb.internal.connection.DefaultConnectionPool$PooledConnection, com.mongodb.internal.connection.CommandProtocolImpl, com.mongodb.internal.connection.DefaultServer$DefaultServerProtocolExecutor, com.mongodb.internal.connection.DefaultServerConnection, com.mongodb.internal.connection.DefaultServerConnection, com.mongodb.internal.connection.DefaultServerConnection, com.mongodb.internal.connection.DefaultServer$OperationCountTrackingConnection, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.async.function.RetryingSyncSupplier, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.BaseFindAndModifyOperation, com.mongodb.client.internal.MongoClusterImpl$OperationExecutorImpl, com.mongodb.client.internal.MongoCollectionImpl, com.mongodb.client.internal.MongoCollectionImpl, jdk.internal.reflect.DirectMethodHandleAccessor, java.lang.reflect.Method, org.springframework.util.ReflectionUtils, org.springframework.data.mongodb.SessionAwareMethodInterceptor, org.springframework.aop.framework.ReflectiveMethodInvocation, org.springframework.aop.framework.JdkDynamicAopProxy, jdk.proxy3.$Proxy213, org.springframework.batch.core.repository.dao.MongoSequenceIncrementer, org.springframework.data.mongodb.core.MongoTemplate, org.springframework.batch.core.repository.dao.MongoSequenceIncrementer, org.springframework.batch.core.repository.dao.MongoStepExecutionDao, org.springframework.batch.core.repository.support.SimpleJobRepository, jdk.internal.reflect.DirectMethodHandleAccessor, java.lang.reflect.Method, org.springframework.aop.support.AopUtils, org.springframework.aop.framework.ReflectiveMethodInvocation, org.springframework.aop.framework.ReflectiveMethodInvocation, org.springframework.transaction.interceptor.TransactionAspectSupport, org.springframework.transaction.interceptor.TransactionInterceptor, org.springframework.aop.framework.ReflectiveMethodInvocation, org.springframework.aop.framework.JdkDynamicAopProxy, jdk.proxy3.$Proxy171, org.springframework.batch.core.job.SimpleStepHandler, org.springframework.batch.core.job.AbstractJob, org.springframework.batch.core.job.SimpleJob, org.springframework.batch.core.job.AbstractJob, org.springframework.batch.core.launch.support.TaskExecutorJobLauncher$1, java.lang.VirtualThread]

[DongSeung2]

may i ask is ther any progress??
@fmbenhassine