Encountering Timeout Issues with Reading Streams on Amazon S3 using Express.js

I am currently facing an issue with streaming videos from an Amazon S3 Bucket. It seems that everything works perfectly when calling my REST endpoint once, but the problem arises when trying to stream the video simultaneously from multiple browsers. The error message I receive is: TimeoutError: Connection timed out after 120000ms

Here's a snippet of my code:

var express = require("express");
var fs = require("fs");
var app = express();
var path = require("path");
var AWS = require("aws-sdk");

// Rest of the code...

I'm uncertain whether this issue lies within the aws-sdk-js or if it's a more general problem with streams. Can anyone provide insight into what might be going wrong here? Has anyone else encountered similar difficulties?

javascriptexpressamazon-s3video-streamingaws-sdk-js

Answer №1

After conducting some research, I've discovered that the behavior mentioned above is greatly influenced by the way in which the video is created. I typically use ffmpeg to convert videos to mp4 format. When I include the faststart flag during the conversion process, there is a noticeable decrease in the number of range requests made by the browser when loading the video. With fewer requests being made, both express and aws-sdk are more equipped to handle the situation without any timeouts occurring.

Answer №2

We have the same goal in mind, but our approach is slightly different. Our aim is to control access to the videos through our backend before streaming them to the user. This is why serving videos directly from s3 is not an option for us. It's worth noting that while the video streams smoothly, we are experiencing a timeout of 120000 ms (AWS default) when using getObject() even after the stream has successfully ended. There seems to be an ongoing issue related to this on the aws-sdk repository that has yet to be resolved.

https://github.com/aws/aws-sdk-js/issues/2087

Similar questions

If you have not found the answer to your question or you are interested in this topic, then look at other similar questions below or use the search

Node.js is raising an error because it cannot locate the specified module, even though the path

Currently in the process of developing my own npm package, I decided to create a separate project for testing purposes. This package is being built in typescript and consists of a main file along with several additional module files. In the main file, I ha ...

javascriptnode.jstypescriptnpmnode-modules

The output from the Moment.js HTTP server is currently experiencing errors and is not displaying the expected

My first time working with JavaScript and the Momentjs library has not been smooth sailing. I am facing an issue where the output is not displaying as required. The goal is to show dates in the format "Day, date month year" (e.g., Tuesday, 14th May 2018). ...

javascriptnode.jsservermomentjs

How can constants from components be defined in multiple ways when imported? (specifically in React)

Although I have a good understanding of React and Javascript, I struggle to articulate my question effectively. I will provide examples in the hopes that someone with more expertise in the field can assist me. For instance, when using import { useRef, use ...

javascriptreactjs

Exploring the implementation of constructors and classes in JavaScript

I have a task to create a class named ShoppingCart with specific instructions: The class should have a constructor that initializes the total attribute to zero and creates an empty dictionary attribute called items. There should be a method named add_ite ...

javascriptnode.jsreactjsoop

The functionality of Jquery Ajax is limited to a single use

I'm having an issue with a page that is supposed to reload the data within a div using jQuery, but it only updates once. Here's a snippet of my code: <html> <head> <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.7.0 ...

javascriptjqueryhtmlajax

Encountering an ETIMEDOUT error while sending out large (10k) post requests with axios.all in a Node

I have implemented axios.all to make simultaneous post calls. Below is the code snippet: let postUrls = []; data.forEach(item => { const itemData = { stream: stream_name, key: item.serialNumber, addr ...

javascriptnode.jspromiseaxiosaxios-retry

What is the best way to define one API route that accommodates two different query combinations?

Is it possible to define 1 API route with 2 different query combination options? We have 2 routes: GET /api/v1/resource?filter=byName&key=restaurant&city=chicago GET /api/v1/resource?filter=byLocation&lat=34&long=78 In soaJS, schema ...

javascriptnode.jssoajs

Is there a way to send a JSON object and a file to an ASP.NET server using the fetch method?

I'm facing a challenge here, as I attempt to send a json object from my indexedDb along with an IFormFile object to the server at the same time. The method that handles this scenario is structured like so: [HttpPost] public async Task<IActionR ...

javascriptasp.netjsonfetch

Beware: Inaccessible code detected in Reactjs usage

Currently, I am working on a ReactJS project where I have integrated two components - PrescriptionIndex and PrescriptionNew. Let's start with the 'PrescriptionNew' component: import React, { Component } from 'react'; import Flo ...

javascriptreactjsmaterial-ui

Run the command "node index.js" to simultaneously start and stop the server

After installing WSL2 and the Ubuntu 22.04 distribution on Windows 11, I set up my environment, installed nvm, Node version 16.17.1, and then ran npm init in my folder. Following that, I installed Express and created an index.js file with a simple structur ...

javascriptnode.jsexpressubuntuwsl-2

"click on the delete button and then hit the addButton

I have created a website where users can save and delete work hours. I am facing an issue where I can save the hours at the beginning, but once I delete them, I cannot save anything anymore. Additionally, when I reload the page, the deleted data reappears. ...

javascripthtmlcss

Browsing HTML Documents with the Click of a Button

After collecting JSON data from a SharePoint list, I am currently in the process of creating an HTML Document. At this point, I have completed approximately 80% of the expected outcome. Due to Cross-Origin Resource Sharing (CORS) restrictions, I have hard ...

javascripthtmljquerycssjson

Toggle a MutationObserver using a button to stop and start monitoring for changes

Is there a way to connect a MutationObserver and disconnect it using the same button? I know how to do each separately, but I want to use just one button. How can I achieve this? Apologies for my poor English. var target = document.getElementsByClassNa ...

javascript

Discovering the vacant fields within a database by looping through them

My goal is to download a .pdf document from the external database Contentful by utilizing an HTML link on a user interface. The issue arises when certain fields inside Contentful do not always necessitate a pdf document. In these cases, the field remains ...

javascriptreactjsmongodb

"What is the process for setting up a file writing stream to Google Cloud Storage using create

I am currently working on a project where I need to write an Express route that can take an image URI in the POST body and save it into a Google Cloud Storage Bucket. However, I am facing issues with persisting the image to the local disk and instead need ...

node.jsexpressgoogle-cloud-storage

What is the best way to obtain a reference to the parent form element within an AngularJS directive?

Here is the HTML code I am working with: <form name="my-form"> <div class="col-sm-4"> <input type="phone" name="mobileNumber" ng-model="form.mobileNumber" value="0439888999" required> </div> </form> In addition, I ha ...

javascriptjqueryangularjs

The jQuery Show Hide feature is experiencing issues specifically on Internet Explorer

Everything looks good in Firefox and Chrome, but unfortunately it's malfunctioning in IE. Does anyone have a suggestion for hiding select Dropdown options? I attempted using CSS with display: none but it didn't work. $j("#id option[value=&apos ...

javascriptjquerycss

Harness the power of the ioHook Node.js global native keyboard and mouse listener within your Browser environment

I'm dealing with a challenging issue that seems to have no solution due to security limitations. However, I'm reaching out to you as my last hope to find a workaround. For my project, I require a system that can monitor user mouse and keyboard a ...

javascriptnode.jsbrowseroperating-systemkeyboard-events

Preserving data in a Node/Express application

As I embark on my first Node/Express app, I find myself in need of guidance on persisting a value consistently across page loads without resorting to using global variables. In the context of my project, the website features three distinct table views pre ...

node.jsexpressmiddleware

Deploying to AWS S3 without the need to update or modify any

Just a heads up - this is not an EC2 instance I have developed a node.js application to handle requests for images by using app.use("/images", s3Proxy({...})). These images are stored in my AWS S3 bucket and then served. I am uploading images to the bucke ...

node.jsamazon-web-servicesexpressamazon-s3