Forums

Resolved
0 votes
Anyone running the web server have timeout issues with larger file uploads to your site? I'm getting this in my httpd error log when uploading and converting many larger video files:
[proxy_fcgi:error] [pid 12108] (70007)The timeout specified has expired: [client 192.168.9.125:62323] AH01075: Error dispatching request to :, referer: https://renncoautomation.us/administrator/index.php?option=com_joomvideos&view=videos


I have a Joomla website and I'm using an application in it called JoomVideos that allows a user to upload videos to be made accessible from the front end of the website. It's a nice app because it makes use of multiple video conversion apps (ffmpeg, qt-faststart, flvtool, and yamdi) installed on my clearos box that process just about any video type and converts them to mp4, allowing them to be played on your site in a nice html5 video player. It works smoothly 60% of the time. It appears that when it doesn't work, this error springs up in my httpd log. The upload portion of the app appears to be working fine. I believe it's during the conversion process that the system times out. It might even be the tail end of the conversion process because you can watch the video in the front end of the website, but you can't access it's configuration in the back end of the site, like it didn't finish the process.

I've beefed up most every associated parameter I can come up with in the httpd.conf, php.ini, and php-fpm configuration files, but none of them take the problem away. Perhaps someone else has had a similar issue in the past?

I'm using ClearOS 7 and PHP 7.1 with the web server.
Friday, February 01 2019, 09:04 PM
Share this post:
Responses (5)
  • Accepted Answer

    Tuesday, February 05 2019, 09:18 PM - #Permalink
    Resolved
    0 votes
    Hey Tony,

    Woeful if this app does not have a debug mode that gives you this and other vital information

    It comes with the option to enabling logging and database errors, but nothing points to what directory any logs are stuffed in. However, thanks to phpMyAdmin that comes with ClearOS, I was able to access the process log. Nothing stands out as different between the videos that finish processing and don't cause a problem and the ones that don't finish processing and don't allow you to access their configuration in the app.

    Does the app specification specify the minimum version of the "converters", Joomla, especially php plus any thing else necessary for this app to run and you satisfy them? Looking for the Docs..

    I did follow their install document here for all the necessary video tools, and I verified libraries were installed when instructed. The howto doc says the library files should show up in /usr/local/lib, but in ClearOS they show up in /usr/lib64. If memory serves me right, I used the versions shown in the howto doc.

    Assuming this is the product from joomboost.com... Did you compile all the software listed in the doc including yasm - or used versions from rpms? You mentioned 3gp files failing - did you compile the opencore-amr software? No minimum version of anything is specified - just expects you to compile everything... not the spirit of an rpm - and there can be issues with this. Be sure, if you compile a piece of software, to remove the rpm and its requires first, otherwise you could have a mixture of versions in different places. A generic compile doesn't necessarily place the files in the same directories as an rpm install does and the attendant problem of which bits of which version are being executed..

    Man, I don't remember as far as the video tools go, because there were so many of them. I tried to stick with the same versions from the howto doc. Most were zips or tar.gz, which were then compiled and installed. I vaguely remember an rpm install (or two). I probably should've written the process down, because it wasn't verbatim with the howto doc (close though). Any rpm files I removed, but I did keep the folder created when I untarred the ffmpeg file, in case I needed to remake and reinstall. I wouldn't think that would cause a conflict.

    It appears in the process log that ffmpeg does most if not all of the processing, interacting with the other video tool libraries I'm sure.
    The reply is currently minimized Show
  • Accepted Answer

    Monday, February 04 2019, 10:04 PM - #Permalink
    Resolved
    0 votes
    Dirk - great you are working with the developer. Just a comment or two...

    I really don't know which converter is working behind the scenes

    Woeful if this app does not have a debug mode that gives you this and other vital information

    never sees a problem on his end when uploading and converting on his server

    Does the app specification specify the minimum version of the "converters", Joomla, especially php plus any thing else necessary for this app to run and you satisfy them? Looking for the Docs...
    later
    Assuming this is the product from joomboost.com... Did you compile all the software listed in the doc including yasm - or used versions from rpms? You mentioned 3gp files failing - did you compile the opencore-amr software? No minimum version of anything is specified - just expects you to compile everything... not the spirit of an rpm - and there can be issues with this. Be sure, if you compile a piece of software, to remove the rpm and its requires first, otherwise you could have a mixture of versions in different places. A generic compile doesn't necessarily place the files in the same directories as an rpm install does and the attendant problem of which bits of which version are being executed...
    The reply is currently minimized Show
  • Accepted Answer

    Monday, February 04 2019, 08:39 PM - #Permalink
    Resolved
    0 votes
    Thanks for that nifty little tool, Marcel. I see the debug choice in the top menu. I'm not quite sure what it does though.

    Hey Tony,

    Same video when uploaded always fails - is it always the same conversion app (ffmpeg, qt-faststart, flvtool, and yamdi)

    Yes, same videos always fail when uploaded and converting, but not all videos fail. I say converting, but the Joomla app calls it processing. I really don't know which converter is working behind the scenes. The developer of the Joomla app has been working with me and never sees a problem on his end when uploading and converting on his server, using the same Joomla app I'm sure. I've given him a login and he sees the timeout error on his end when working directly with my site.

    Increase the conversion app's log level for more information e.g. the ffmpeg "-loglevel" option

    Assuming ffmpeg is doing the converting, when I implement verbose logging with no other options, I see the following response. No errors spring up and I get an mp4 file that I can upload through the Joomla app. I still have the same problems with this mp4 though.

    ffmpeg -i /ffmpeg/Videos/MOV05190.MPG /ffmpeg/Videos/Converted/MOV05190.mp4 -v verbose
    [mpeg @ 0xef5520] max_analyze_duration 7000000 reached at 7020000 microseconds st:0
    Input #0, mpeg, from '/ffmpeg/Videos/MOV05190.MPG':
    Duration: 00:01:00.08, start: 0.110000, bitrate: 2913 kb/s
    Stream #0:0[0x1c0]: Audio: mp2, 32000 Hz, mono, s16p, 64 kb/s
    Stream #0:1[0x1e0]: Video: mpeg1video, 1 reference frame, yuv420p(tv), 640x480 [SAR 1:1 DAR 4:3] , 104857 kb/s, 25 fps, 25 tbr, 90k tbn, 25 tbc
    [graph 0 input from stream 0:1 @ 0x114e6e0] w:640 h:480 pixfmt:yuv420p tb:1/90000 fr:25/1 sar:1/1 sw s_param:flags=2
    [graph 1 input from stream 0:0 @ 0x114fd00] tb:1/32000 samplefmt:s16p samplerate:32000 chlayout:0x4
    [audio format for output stream 0:1 @ 0x114fae0] auto-inserting filter 'auto-inserted resampler 0' b etween the filter 'Parsed_anull_0' and the filter 'audio format for output stream 0:1'
    [auto-inserted resampler 0 @ 0x1152b00] ch:1 chl:mono fmt:s16p r:32000Hz -> ch:1 chl:mono fmt:fltp r :32000Hz
    [libx264 @ 0xefd2c0] using SAR=1/1
    [libx264 @ 0xefd2c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
    [libx264 @ 0xefd2c0] profile High, level 3.0
    [libx264 @ 0xefd2c0] 264 - core 148 - H.264/MPEG-4 AVC codec - Copyleft 2003-2016 - http://www.video lan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_ rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip= 1 chroma_qp_offset=-2 threads=3 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bl uray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_g op=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
    [mp4 @ 0xefc160] Using AVStream.codec to pass codec parameters to muxers is deprecated, use AVStream .codecpar instead.
    Last message repeated 1 times
    Output #0, mp4, to '/ffmpeg/Videos/Converted/MOV05190.mp4':
    Metadata:
    encoder : Lavf57.41.100
    Stream #0:0: Video: h264 (libx264), 1 reference frame ([33][0][0][0] / 0x0021), yuv420p, 640x480 [SAR 1:1 DAR 4:3], q=-1--1, 25 fps, 12800 tbn, 25 tbc
    Metadata:
    encoder : Lavc57.48.101 libx264
    Side data:
    cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
    Stream #0:1: Audio: aac (LC) ([64][0][0][0] / 0x0040), 32000 Hz, mono, fltp, 69 kb/s
    Metadata:
    encoder : Lavc57.48.101 aac
    Stream mapping:
    Stream #0:1 -> #0:0 (mpeg1video (native) -> h264 (libx264))
    Stream #0:0 -> #0:1 (mp2 (native) -> aac (native))
    Press [q] to stop, [?] for help
    No more output streams to write to, finishing.e=00:00:59.71 bitrate=1949.2kbits/s speed=1.31x
    frame= 1503 fps= 32 q=-1.0 Lsize= 14877kB time=00:01:00.12 bitrate=2026.9kbits/s speed=1.27x
    video:14319kB audio:511kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.31546 5%
    Input file #0 (/ffmpeg/Videos/MOV05190.MPG):
    Input stream #0:0 (audio): 1670 packets read (480960 bytes); 1670 frames decoded (1923840 samples) ;
    Input stream #0:1 (video): 1503 packets read (19731275 bytes); 1503 frames decoded;
    Total: 3173 packets (20212235 bytes) demuxed
    Output file #0 (/ffmpeg/Videos/Converted/MOV05190.mp4):
    Output stream #0:0 (video): 1503 frames encoded; 1503 packets muxed (14662423 bytes);
    Output stream #0:1 (audio): 1879 frames encoded (1923840 samples); 1880 packets muxed (523730 byte s);
    Total: 3383 packets (15186153 bytes) muxed
    [libx264 @ 0xefd2c0] frame I:12 Avg QP:23.88 size: 22174
    [libx264 @ 0xefd2c0] frame P:496 Avg QP:26.20 size: 18238
    [libx264 @ 0xefd2c0] frame B:995 Avg QP:26.88 size: 5377
    [libx264 @ 0xefd2c0] consecutive B-frames: 1.5% 30.7% 0.2% 67.6%
    [libx264 @ 0xefd2c0] mb I I16..4: 4.2% 95.6% 0.3%
    [libx264 @ 0xefd2c0] mb P I16..4: 4.6% 69.9% 1.5% P16..4: 8.6% 9.0% 4.8% 0.0% 0.0% skip: 1.7%
    [libx264 @ 0xefd2c0] mb B I16..4: 1.7% 18.8% 0.1% B16..8: 10.7% 6.7% 2.2% direct: 4.6% skip: 55.1% L0:29.8% L1:43.0% BI:27.2%
    [libx264 @ 0xefd2c0] 8x8 transform intra:91.7% inter:77.5%
    [libx264 @ 0xefd2c0] coded y,uvDC,uvAC intra: 79.9% 84.6% 43.3% inter: 24.2% 24.1% 9.5%
    [libx264 @ 0xefd2c0] i16 v,h,dc,p: 52% 20% 25% 2%
    [libx264 @ 0xefd2c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 38% 23% 28% 2% 1% 1% 1% 2% 3%
    [libx264 @ 0xefd2c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 39% 24% 10% 3% 4% 5% 4% 4% 6%
    [libx264 @ 0xefd2c0] i8c dc,h,v,p: 36% 21% 37% 6%
    [libx264 @ 0xefd2c0] Weighted P-Frames: Y:12.7% UV:7.3%
    [libx264 @ 0xefd2c0] ref P L0: 40.6% 14.2% 26.7% 16.9% 1.6%
    [libx264 @ 0xefd2c0] ref B L0: 72.4% 22.3% 5.3%
    [libx264 @ 0xefd2c0] ref B L1: 99.6% 0.4%
    [libx264 @ 0xefd2c0] kb/s:1951.00
    [aac @ 0x11442c0] Qavg: 210.758



    Enough memory
    Server doing anything else significant when fails
    Related to time of day
    Size of video being uploaded
    Type of video being uploaded


    My COS gateway hasn't failed any with my other servers that are running. We do stream music from iHeart radio for the guys out in our shop, but that's from a network computer. We are using GM for content filtering. Always trying it 8am-5pm EST. Larger videos have been done successfully. That's why this doesn't make any sense. I'll have to look more at if it's a video type problem. So far I am noticing it with mpegs, whereas wmv and mp4's not really. I haven't tried anything flv, but I did try 3gp files with no real success. The JoomVideos app will upload about anything and look like it's processed them through, but in the end, not so much. With my luck it's an ffmpeg issue, although it doesn't look like it above.

    Thanks for your comments and help fellas.
    The reply is currently minimized Show
  • Accepted Answer

    Saturday, February 02 2019, 07:01 AM - #Permalink
    Resolved
    0 votes
    What I should do is try to diagnostic the problem. Use different video files. Check video format and audio format and also the container. Then upload them to you Joomla site. Maybe a encoder has a limitation and can handle a audio format like dolby digital plus (EAC3). Also make notes of what you do!

    With mediaInfo you can check your video files.

    MediaInfo website
    The reply is currently minimized Show
  • Accepted Answer

    Saturday, February 02 2019, 12:37 AM - #Permalink
    Resolved
    0 votes
    Dirk - any patterns?
    Same video when uploaded always fails - is it always the same conversion app (ffmpeg, qt-faststart, flvtool, and yamdi)
    Increase the conversion app's log level for more information e.g. the ffmpeg "-loglevel" option
    Enough memory
    Server doing anything else significant when fails
    Related to time of day
    Size of video being uploaded
    Type of video being uploaded
    The reply is currently minimized Show
Your Reply