S3 upload issue

[BugLiteyear]

Hello i am having issue in s3 upload for mp4 files.
here is the log
undefined-22 04:56:38,216 [vert.x-worker-thread-31] INFO io.antmedia.muxer.Mp4Muxer - writing trailer for stream: Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,223 [vert.x-worker-thread-31] INFO io.antmedia.muxer.HLSMuxer - writing trailer for stream: Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,224 [vert.x-worker-thread-31] INFO io.antmedia.muxer.HLSMuxer - Delete File onexit:true upload to S3:true stream:Liu1Zsvw89C81687408461225 hls time:2 hlslist size:5
2023-06-22 04:56:38,243 [vert.x-worker-thread-31] INFO i.a.e.adaptive.EncoderAdaptor - closing input and number of dropped packets 0
2023-06-22 04:56:38,243 [vert.x-worker-thread-31] INFO i.a.e.adaptive.EncoderAdaptor - Total video encode time 0ms, average video encode time 0ms total audio encode time 128ms total video decode time 0ms , average video decode time 0 ms
2023-06-22 04:56:38,244 [vert.x-worker-thread-31] WARN io.antmedia.muxer.MuxAdaptor - closed adaptor for Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,252 [vert.x-worker-thread-36] INFO i.a.e.adaptive.StreamAdaptor - Recording set to false in streamadaptor: 1115261806 for stream: Liu1Zsvw89C81687408461225 stopping scheduler job id: 17
2023-06-22 04:56:38,252 [vert.x-worker-thread-36] INFO i.a.e.adaptive.StreamAdaptor - Flushing video encoder:SFUForwarder for stream adaptor:1115261806 stream id:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,254 [vert.x-worker-thread-36] ERROR i.a.e.adaptive.audio.OpusEncoder - Cannot send audio frame to encoder for stream index 1 error is End of file for stream:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,254 [vert.x-worker-thread-36] INFO i.a.e.adaptive.StreamAdaptor - Flushing audio encoder:libopus for stream adaptor:1115261806 stream id:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,254 [vert.x-worker-thread-36] INFO i.a.enterprise.webrtc.WebRTCAdaptor - unregistering Liu1Zsvw89C81687408461225 muxer with 360p and codec: H264 from webrtc adaptor
2023-06-22 04:56:38,255 [vert.x-worker-thread-36] INFO i.a.enterprise.webrtc.WebRTCAdaptor - Decreasing number of live streams: 0 and stream id:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,255 [vert.x-worker-thread-36] INFO i.a.enterprise.webrtc.WebRTCMuxer - Average write packet call interval for video 16ms average video packet processing time 0ms video packet count: 2270 for stream:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,255 [vert.x-worker-thread-36] INFO i.a.enterprise.webrtc.WebRTCMuxer - Average write packet call interval: 19ms average audio processing time: 0ms audio packet count: 1891 for stream:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,255 [vert.x-worker-thread-36] INFO i.a.enterprise.webrtc.WebRTCMuxer - WebRTC Client 2141192385 video frame average sent period: 16.570484 audio frame average period: 19.90164 for stream:Liu1Zsvw89C81687408461225 type:OriginServer
2023-06-22 04:56:38,256 [vert.x-worker-thread-36] INFO i.a.e.cluster.webrtc.OriginServer - Stoping Origin Server
2023-06-22 04:56:38,256 [vert.x-worker-thread-36] INFO i.a.enterprise.webrtc.WebRTCMuxer - unregister webrtc client(2141192385) to webrtc muxer(360p - codec:H264) for stream: Liu1Zsvw89C81687408461225 current viewer count:0 decremented:true
2023-06-22 04:56:38,256 [vert.x-worker-thread-36] INFO i.a.e.cluster.webrtc.OriginServer - Origin server is stopped
2023-06-22 04:56:38,256 [vert.x-worker-thread-36] INFO i.a.e.adaptive.video.SFUForwarder - Video codec writing trailer name: SFUForwarder height:360 for stream:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,256 [vert.x-worker-thread-36] INFO i.a.e.adaptive.video.SFUForwarder - Total processing time 0 ms Average processing time 0 ms per frame for stream:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,256 [vert.x-worker-thread-36] INFO i.a.e.adaptive.audio.OpusEncoder - writing trailer codec name: libopus bitrate:96000 for stream:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,256 [vert.x-worker-thread-36] INFO i.a.e.adaptive.audio.OpusEncoder - Total processing time 3897, Average processing time 1 ms per frame on average for stream:Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,256 [vert.x-worker-thread-36] INFO i.a.e.adaptive.StreamAdaptor - Average thread entrance interval 9ms for stream: Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,257 [vert.x-worker-thread-36] INFO i.a.e.adaptive.StreamAdaptor - Leaving streamadaptor: 1115261806 for stream: Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,597 [vert.x-worker-thread-33] INFO io.antmedia.muxer.Mp4Muxer - Liu1Zsvw89C81687408461225_1.mp4 is ready
2023-06-22 04:56:38,621 [vert.x-worker-thread-33] INFO io.antmedia.muxer.Mp4Muxer - File: /usr/local/antmedia/webapps/WebRTCAppEE/streams/Liu1Zsvw89C81687408461225_1.mp4.tmp_extension exist: false
2023-06-22 04:56:38,621 [vert.x-worker-thread-33] INFO io.antmedia.muxer.Mp4Muxer - Storage client is available saving Liu1Zsvw89C81687408461225_1.mp4 to storage
2023-06-22 04:56:38,641 [vert.x-worker-thread-33] INFO i.a.storage.AmazonS3StorageClient - Liu1Zsvw89C81687408461225_1.mp4 upload has started with key: streams/Liu1Zsvw89C81687408461225_1.mp4
2023-06-22 04:56:38,644 [vert.x-worker-thread-33] INFO i.a.AntMediaApplicationAdapter - Closing broadcast stream id: Liu1Zsvw89C81687408461225
2023-06-22 04:56:38,657 [vert.x-worker-thread-33] INFO io.antmedia.statistic.ViewerStats - Reset hls Stream ID: Liu1Zsvw89C81687408461225 remove failed or null
2023-06-22 04:56:38,658 [vert.x-worker-thread-33] INFO io.antmedia.statistic.ViewerStats - Reset dash Stream ID: Liu1Zsvw89C81687408461225 remove failed or null
2023-06-22 04:56:38,768 [java-sdk-progress-listener-callback-thread] ERROR i.a.storage.AmazonS3StorageClient - S3 - Error: Upload failed for Liu1Zsvw89C81687408461225_1.mp4 with key streams/Liu1Zsvw89C81687408461225_1.mp4
2023-06-22 04:56:48,246 [vert.x-eventloop-thread-2] INFO i.a.storage.AmazonS3StorageClient - Liu1Zsvw89C81687408461225000000014.ts upload has started with key: streams/Liu1Zsvw89C81687408461225000000014.ts
2023-06-22 04:56:48,247 [vert.x-eventloop-thread-2] INFO i.a.storage.AmazonS3StorageClient - Liu1Zsvw89C81687408461225000000016.ts upload has started with key: streams/Liu1Zsvw89C81687408461225000000016.ts
2023-06-22 04:56:48,248 [vert.x-eventloop-thread-2] INFO i.a.storage.AmazonS3StorageClient - Liu1Zsvw89C81687408461225000000012.ts upload has started with key: streams/Liu1Zsvw89C81687408461225000000012.ts
2023-06-22 04:56:48,248 [vert.x-eventloop-thread-2] INFO i.a.storage.AmazonS3StorageClient - Liu1Zsvw89C81687408461225000000015.ts upload has started with key: streams/Liu1Zsvw89C81687408461225000000015.ts
2023-06-22 04:56:48,249 [vert.x-eventloop-thread-2] INFO i.a.storage.AmazonS3StorageClient - Liu1Zsvw89C81687408461225000000017.ts upload has started with key: streams/Liu1Zsvw89C81687408461225000000017.ts
2023-06-22 04:56:48,257 [vert.x-eventloop-thread-2] INFO i.a.storage.AmazonS3StorageClient - Liu1Zsvw89C81687408461225.m3u8 upload has started with key: streams/Liu1Zsvw89C81687408461225.m3u8
2023-06-22 04:56:48,260 [vert.x-eventloop-thread-2] INFO i.a.storage.AmazonS3StorageClient - Liu1Zsvw89C81687408461225000000013.ts upload has started with key: streams/Liu1Zsvw89C81687408461225000000013.ts
2023-06-22 04:56:48,328 [java-sdk-progress-listener-callback-thread] ERROR i.a.storage.AmazonS3StorageClient - S3 - Error: Upload failed for Liu1Zsvw89C81687408461225000000016.ts with key streams/Liu1Zsvw89C81687408461225000000016.ts
2023-06-22 04:56:48,328 [java-sdk-progress-listener-callback-thread] ERROR i.a.storage.AmazonS3StorageClient - S3 - Error: Upload failed for Liu1Zsvw89C81687408461225000000013.ts with key streams/Liu1Zsvw89C81687408461225000000013.ts
2023-06-22 04:56:48,353 [java-sdk-progress-listener-callback-thread] ERROR i.a.storage.AmazonS3StorageClient - S3 - Error: Upload failed for Liu1Zsvw89C81687408461225.m3u8 with key streams/Liu1Zsvw89C81687408461225.m3u8
2023-06-22 04:56:48,354 [java-sdk-progress-listener-callback-thread] ERROR i.a.storage.AmazonS3StorageClient - S3 - Error: Upload failed for Liu1Zsvw89C81687408461225000000012.ts with key streams/Liu1Zsvw89C81687408461225000000012.ts
2023-06-22 04:56:48,354 [java-sdk-progress-listener-callback-thread] ERROR i.a.storage.AmazonS3StorageClient - S3 - Error: Upload failed for Liu1Zsvw89C81687408461225000000017.ts with key streams/Liu1Zsvw89C81687408461225000000017.ts
2023-06-22 04:56:48,355 [java-sdk-progress-listener-callback-thread] ERROR i.a.storage.AmazonS3StorageClient - S3 - Error: Upload failed for Liu1Zsvw89C81687408461225000000015.ts with key streams/Liu1Zsvw89C81687408461225000000015.ts
2023-06-22 04:56:48,362 [java-sdk-progress-listener-callback-thread] ERROR i.a.storage.AmazonS3StorageClient - S3 - Error: Upload failed for Liu1Zsvw89C81687408461225000000014.ts with key streams/Liu1Zsvw89C81687408461225000000014.ts
2023-06-22 04:57:19,473 [https-jsse-nio2-0.0.0.0-5443-exec-1] WARN i.a.filter.TokenFilterManager - No streamId found in the request: /WebRTCAppEE/streams/streams/Liu1Zsvw89C81687408461225_1.mp4/Liu1Zsvw89C81687408461225_1.mp4_adaptive.mp4
2023-06-22 04:57:19,722 [https-jsse-nio2-0.0.0.0-5443-exec-2] WARN i.a.filter.TokenFilterManager - No streamId found in the request: /WebRTCAppEE/streams/streams/Liu1Zsvw89C81687408461225_1.mp4/Liu1Zsvw89C81687408461225_1.mp4_adaptive.mp4
2023-06-22 04:57:25,473 [https-jsse-nio2-0.0.0.0-5443-exec-3] WARN i.a.filter.TokenFilterManager - No streamId found in the request: /WebRTCAppEE/streams/streams/Liu1Zsvw89C81687408461225_1.mp4/Liu1Zsvw89C81687408461225_1.mp4_adaptive.mp4
2023-06-22 04:59:31,007 [vert.x-eventloop-thread-0] INFO i.antmedia.statistic.StatsCollector - System cpu load:0 process cpu load:1 available memory: 6715448 KB used memory(RSS): 657680 KB
2023-06-22 04:59:31,007 [vert.x-eventloop-thread-0] INFO i.antmedia.statistic.StatsCollector - Vertx worker queue size:0 WebRTCVertx worker queue size:0

[yashtandon113]

@BugLiteyear
Thanks for sharing the logs. Could you please share the screenshot of your application settings?
Also please make sure that the bucket is public.

[BugLiteyear]

@yashtandon113 upload issue is fixed , but ant-media is uploading all files (.ts, .m3u8 and mp4). i also changed the config of red5-web.properties to "settings.uploadExtensionsToS3=7" or "settings.uploadExtensionsToS3=100" to only upload mp4 files but it is uploading all files.

event HTTP forwarding is not working.
settings.httpforwarding.baseURL=https://ant-stream.s3.ap-southeast-2.amazonaws.com when i am playing recorded video it shows content not available.

[yashtandon113]

@BugLiteyear
In order to only upload the mp4, you need to use below setting. These settings are defined here.

settings.uploadExtensionsToS3=1

Also please make sure that you have added below property as well other then HTTP forward URL. You can check s3 document for more details.

settings.httpforwarding.extension=mp4

After making the changes, please restart the server.

If you still face the issue then we can check it together.

[BugLiteyear]

i tried to set those settings , but when I start streaming it automatically changes to 7 from 1. also HTTP forwarding is not working

[yashtandon113]

@BugLiteyear
Which version of Ant Media Server are you using?

[BugLiteyear]

@yashtandon113 Enterprise Edition 2.6.0 20230517_0442

[BugLiteyear]

@yashtandon113 any update?

[yashtandon113]

@BugLiteyear
We can schedule a meeting to check this issue together. Please let me know your availability for today.

[yashtandon113]

@skyJasonCruzz

Our meeting with @BugLiteyear was not scheduled, so we couldn't investigate the case.

If your bucket is public, can you please share a screenshot of your application settings? You can hide the secret and access the key while sharing.