| Author |
|
=fb3= Flashcom Badass


Joined: 07 February 2004 Location: United States Posts: 509
|
| Posted: 28 January 2010 at 23:34 | IP Logged
|
|
|
We are seeing excessive ram usage on our playback server to a point where it eventually goes to 100% and we have to reboot. We have been doing this for many years and there never seemed to be an issue until we upgraded to FMS 3.5 ....and we are using the latest build.
We never have more that 50 to 70 videos playing and they are less than 20 min usually.
We have optimized setting, bla bla bla and even created reaper apps to remove instances in just a minute or two if no connection to it are found.
Its a new strong linux box with 7 gb ram and there should be no issues with the small amount of videos being played.
We never had this issue with older FMS versions and I go back to FCS 1.0 so I know my way around.
Currently there are 25 connections and using over 50% ram!!!! according to the adminConsole anyways.
Also we only stream .flv created with fms 3.5 on our own servers.
We do see backward timestamp errors sometimes while live encoding these same streams we playback. could this be the issue?....We never seem to get a fix for that problem but that's another issue I suppose.
I would hate to revert back to FMS 2 or even switch to Wowza because it may be something else.
This is driving me crazy
Anyone else seeing this?
__________________ www.virtualjam.net
|
| Back to Top |
|
| |
jaycharles Moderator

Joined: 18 February 2004 Posts: 508
|
| Posted: 29 January 2010 at 12:33 | IP Logged
|
|
|
Any chance you upped the limit on the FLV cache size?
The MaxSize for the FLV cache is per core. So, for example, if you have the MaxSize set to 1024MB, and you're running 4 cores, you could easily consume 4GB+ ram.
I find that the flvcache doesn't empty until the cache times out, or the core process is stopped. So, even if you stop the app instance, the memory used by the FLVCache may not be freed.
__________________ http://www.jaycharles.net
|
| Back to Top |
|
| |
=fb3= Flashcom Badass


Joined: 07 February 2004 Location: United States Posts: 509
|
| Posted: 29 January 2010 at 14:21 | IP Logged
|
|
|
Hi, I did change that but as you say, it got worse so I put it back to 500mb original setting.
Also your right, Unloading the apps does not clear the memory.
What should I try next, Lower the 500 mb setting?
__________________ www.virtualjam.net
|
| Back to Top |
|
| |
jaycharles Moderator

Joined: 18 February 2004 Posts: 508
|
| Posted: 29 January 2010 at 15:02 | IP Logged
|
|
|
Since the problem got worse when you made the flvcache max larger, it seems reasonable to suspect that's the source of the large memory use.
You can lower the max cache size if you need to reduce memory use. The tradeoff is increase disk use on popular files (fewer chunks in ram means reading from disk more often. That said, if the system isn't starving for memory, leave it alone. Allowing FMS to have a large cache can improve overall system performance.
IF you can't let FMS use that much memory....
If your deployment involves a lot of little flv's that only one or two people connect to, you might consider taking a different approach to application instances and core process configuration.
For example, if you set your process scope to run a unique core per application. Each time all instances of that app shut down, the core should shut down too (thereby dumping the FLVCache associated with the core).
I haven't tested this approach with a VOD application myself... if you try it let me know what your results are.
__________________ http://www.jaycharles.net
|
| Back to Top |
|
| |
=fb3= Flashcom Badass


Joined: 07 February 2004 Location: United States Posts: 509
|
| Posted: 30 January 2010 at 00:29 | IP Logged
|
|
|
Thanks for the feedback.
I will do some tests and let you know my results.
Cheers.
__________________ www.virtualjam.net
|
| Back to Top |
|
| |
=fb3= Flashcom Badass


Joined: 07 February 2004 Location: United States Posts: 509
|
| Posted: 09 February 2010 at 14:01 | IP Logged
|
|
|
OK so after 2 weeks I have only had to restart the playback server 2 times! Vast improvement and I can live with that. Using lower settings in the fms.ini was the ticket I guess. I am using 300mb as the default max size and since we stream short videos this seems to help.
Thanks for your feedback Jay!
__________________ www.virtualjam.net
|
| Back to Top |
|
| |
jaycharles Moderator

Joined: 18 February 2004 Posts: 508
|
| Posted: 09 February 2010 at 14:35 | IP Logged
|
|
|
Glad to know you're seeing better performance. You could also go one step further, and reduce the cache timeout (I'm pretty sure that's not in the fms.ini settings... you'll need to edit it in server.xml). If you reduce the cache timeout, cached chunks will be released sooner.
__________________ http://www.jaycharles.net
|
| Back to Top |
|
| |