render farm meet file server

link · January 10th, 2007

hi there. i've got two big deadlines converging along with some recent hardware changes, and the result is not pretty. having tried everything within my limited networking knowledge, I hope someone out there might have some better ideas!

first, the setup: i have a speedy dual xeon workstation where i work, and set it to render when i'm not. then there are 5 p4 render nodes, each with 1-2gb of ram. finally, and this is my recent addition, i have a dedicated file server where all project files are located on a raid 10 drive setup. a separate non-raid drive collects the output. the network is gigabit, and its a simple xp peer-peer.

and here's the problem: as i am working on files in max, autocad, or photoshop, occasionally the software will hang, typically when going to save. when this happens the workstation and all the render nodes lose connection to the server (i'm using mapped drives now, though was using all UNC in max with the same problem). i need to restart the server to get the connection back. there are plenty of spontaneous failures amongst the nodes as well, where they get TIFFOpen failures.

i presume the problem lies with the server... but i'm at a loss what to do. its an HP Proliant ML150 SATA, and i know this is not "supposed" to run xp, and maybe thats the problem??? the nic drivers are for win2003 i think, but they seem to work fine for the most part.

or is it just too much to ask a peer to peer network to be rendering on 5-6 machines?

thanks in advance!

Horhe · January 10th, 2007

So the workstation hangs up when you are working in max or under photoshop and not during rendering? If so the problem may lie in your hard drive and/or windows.

I have a dual xeon w/s, and I get errors from time to time with photoshop and max aswell.
Amazingly there are a lot of people who just dont run defragmentation on their hard drives - or dont run them as many times as they should. Yes it takes a while and its not interesting to sit and look at it maybe in the future windows will implement a platform game where you can blast your way through while waiting for your files to sort.

Another thing - if your hard drive is packed so much that you hardly got space to install tetris then i recomend deleting your old 3ds application backup files and leaving the rencent 3 (dont know about you but i work on max and after a project is completed i end up with lots of backup files taking up lots and lots of space - thank god the program stability is constantly updated and taken into account with every new version that comes out - or so they say cause i hardly notice that :P).

If youre using Windows system (another chair broken) then ill share some value information with you. I read somewhere that windows is incompatible with 3dsmax, and it destroys the installed application by altering its files and making new ones making max choke. Anyway when it comes to windows - reinstaling it AT LEAST once a year will make the system work better. Either that or remove it, and write a letter to microsoft to make them aware that they have one less customer. Curse the day this evil feindish software emerged from the dark into our world!

If you are rendering and using photoshop at the same time then dont - 3d aps are real mongers when it comes to resources (i know max is for sure), decide what, when and..... er... when.

keep posting, im curious if youll solve this and wheater im right :P

cheers

Horhe · January 10th, 2007

So the workstation hangs up when you are working in max or under photoshop and not during rendering? If so the problem may lie in your hard drive and/or windows.

I have a dual xeon w/s, and I get errors from time to time with photoshop and max aswell.
Amazingly there are a lot of people who just dont run defragmentation on their hard drives - or dont run them as many times as they should. Yes it takes a while and its not interesting to sit and look at it maybe in the future windows will implement a platform game where you can blast your way through while waiting for your files to sort.

Another thing - if your hard drive is packed so much that you hardly got space to install tetris then i recomend deleting your old 3ds application backup files and leaving the rencent 3 (dont know about you but i work on max and after a project is completed i end up with lots of backup files taking up lots and lots of space - thank god the program stability is constantly updated and taken into account with every new version that comes out - or so they say cause i hardly notice that :P).

If youre using Windows system (another chair broken) then ill share some value information with you. I read somewhere that windows is incompatible with 3dsmax, and it destroys the installed application by altering its files and making new ones making max choke. Anyway when it comes to windows - reinstaling it AT LEAST once a year will make the system work better. Either that or remove it, and write a letter to microsoft to make them aware that they have one less customer. Curse the day this evil feindish software emerged from the dark into our world!

If you are rendering and using photoshop at the same time then dont - 3d aps are real mongers when it comes to resources (i know max is for sure), decide what, when and..... er... when.

keep posting, im curious if youll solve this and wheater im right :P

cheers

Horhe · January 10th, 2007

sorry for the double post, not my fault something jammed up my cpu

link · January 10th, 2007

The problem does seem to lie with the drives, but since they are new, I just set them up in a raid array, they can't be needing defragmentation. I do have nearly all my projects of the past few years on there, maybe its time to move some off. The array is 300gb and is filled with 200gb (47,000 files) of projects and another 10gb (14,000 files) of bitmaps and such.

I made it a "dynamic" drive, with a 250gb volume (projects) and a 50gb volume (maps). Could this be an issue? its hardware raid so really there was no need to make it dynamic.

Everything WinXp Pro... will explore linux someday when there's "time". ha ha!

January 10th, 2007	#1 (permalink)
link Junior Member Join Date: Jul 2004 Location: Burlington,VT Age: 33 Posts: 10 Name: Lincoln Brown	render farm meet file server hi there. i've got two big deadlines converging along with some recent hardware changes, and the result is not pretty. having tried everything within my limited networking knowledge, I hope someone out there might have some better ideas! first, the setup: i have a speedy dual xeon workstation where i work, and set it to render when i'm not. then there are 5 p4 render nodes, each with 1-2gb of ram. finally, and this is my recent addition, i have a dedicated file server where all project files are located on a raid 10 drive setup. a separate non-raid drive collects the output. the network is gigabit, and its a simple xp peer-peer. and here's the problem: as i am working on files in max, autocad, or photoshop, occasionally the software will hang, typically when going to save. when this happens the workstation and all the render nodes lose connection to the server (i'm using mapped drives now, though was using all UNC in max with the same problem). i need to restart the server to get the connection back. there are plenty of spontaneous failures amongst the nodes as well, where they get TIFFOpen failures. i presume the problem lies with the server... but i'm at a loss what to do. its an HP Proliant ML150 SATA, and i know this is not "supposed" to run xp, and maybe thats the problem??? the nic drivers are for win2003 i think, but they seem to work fine for the most part. or is it just too much to ask a peer to peer network to be rendering on 5-6 machines? thanks in advance! __________________ Lincoln Brown upLink3d

January 10th, 2007	#2 (permalink)
Horhe Veteran Member Join Date: Nov 2005 Location: Poland Age: 26 Posts: 1,172 Name: Jakub Gabriel	Re: render farm meet file server So the workstation hangs up when you are working in max or under photoshop and not during rendering? If so the problem may lie in your hard drive and/or windows. I have a dual xeon w/s, and I get errors from time to time with photoshop and max aswell. Amazingly there are a lot of people who just dont run defragmentation on their hard drives - or dont run them as many times as they should. Yes it takes a while and its not interesting to sit and look at it maybe in the future windows will implement a platform game where you can blast your way through while waiting for your files to sort. Another thing - if your hard drive is packed so much that you hardly got space to install tetris then i recomend deleting your old 3ds application backup files and leaving the rencent 3 (dont know about you but i work on max and after a project is completed i end up with lots of backup files taking up lots and lots of space - thank god the program stability is constantly updated and taken into account with every new version that comes out - or so they say cause i hardly notice that :P). If youre using Windows system (another chair broken) then ill share some value information with you. I read somewhere that windows is incompatible with 3dsmax, and it destroys the installed application by altering its files and making new ones making max choke. Anyway when it comes to windows - reinstaling it AT LEAST once a year will make the system work better. Either that or remove it, and write a letter to microsoft to make them aware that they have one less customer. Curse the day this evil feindish software emerged from the dark into our world! If you are rendering and using photoshop at the same time then dont - 3d aps are real mongers when it comes to resources (i know max is for sure), decide what, when and..... er... when. keep posting, im curious if youll solve this and wheater im right :P cheers __________________ Im starting to suspect that the world is a rendering... www.JakubGabriel.com \| DoodlesWhileCookingNoodles

January 10th, 2007	#3 (permalink)
Horhe Veteran Member Join Date: Nov 2005 Location: Poland Age: 26 Posts: 1,172 Name: Jakub Gabriel	Re: render farm meet file server So the workstation hangs up when you are working in max or under photoshop and not during rendering? If so the problem may lie in your hard drive and/or windows. I have a dual xeon w/s, and I get errors from time to time with photoshop and max aswell. Amazingly there are a lot of people who just dont run defragmentation on their hard drives - or dont run them as many times as they should. Yes it takes a while and its not interesting to sit and look at it maybe in the future windows will implement a platform game where you can blast your way through while waiting for your files to sort. Another thing - if your hard drive is packed so much that you hardly got space to install tetris then i recomend deleting your old 3ds application backup files and leaving the rencent 3 (dont know about you but i work on max and after a project is completed i end up with lots of backup files taking up lots and lots of space - thank god the program stability is constantly updated and taken into account with every new version that comes out - or so they say cause i hardly notice that :P). If youre using Windows system (another chair broken) then ill share some value information with you. I read somewhere that windows is incompatible with 3dsmax, and it destroys the installed application by altering its files and making new ones making max choke. Anyway when it comes to windows - reinstaling it AT LEAST once a year will make the system work better. Either that or remove it, and write a letter to microsoft to make them aware that they have one less customer. Curse the day this evil feindish software emerged from the dark into our world! If you are rendering and using photoshop at the same time then dont - 3d aps are real mongers when it comes to resources (i know max is for sure), decide what, when and..... er... when. keep posting, im curious if youll solve this and wheater im right :P cheers __________________ Im starting to suspect that the world is a rendering... www.JakubGabriel.com \| DoodlesWhileCookingNoodles

January 10th, 2007	#4 (permalink)
Horhe Veteran Member Join Date: Nov 2005 Location: Poland Age: 26 Posts: 1,172 Name: Jakub Gabriel	Re: render farm meet file server sorry for the double post, not my fault something jammed up my cpu __________________ Im starting to suspect that the world is a rendering... www.JakubGabriel.com \| DoodlesWhileCookingNoodles

January 10th, 2007	#5 (permalink)
link Junior Member Join Date: Jul 2004 Location: Burlington,VT Age: 33 Posts: 10 Name: Lincoln Brown	Re: render farm meet file server The problem does seem to lie with the drives, but since they are new, I just set them up in a raid array, they can't be needing defragmentation. I do have nearly all my projects of the past few years on there, maybe its time to move some off. The array is 300gb and is filled with 200gb (47,000 files) of projects and another 10gb (14,000 files) of bitmaps and such. I made it a "dynamic" drive, with a 250gb volume (projects) and a 50gb volume (maps). Could this be an issue? its hardware raid so really there was no need to make it dynamic. Everything WinXp Pro... will explore linux someday when there's "time". ha ha! __________________ Lincoln Brown upLink3d

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
render farm	prince_moks	General Discussions	4	March 16th, 2006 08:41 PM
Basic render server..	alfienoakes	Hardware and Technical Discusions	2	January 13th, 2006 02:50 AM
File server	settec+	Hardware and Technical Discusions	6	June 7th, 2004 09:10 PM
A large file size...how to render it??	Max user	3ds Max	3	July 26th, 2003 09:52 AM
cinema 4d	PiNkFlUiD	Finished Work	13	February 28th, 2003 05:00 AM