Long time calculation

Post your tutorials and help questions in this forum
Locked
Alexis
Posts: 71
Joined: Mon Aug 02, 2010 10:32 am
Location: France
Contact:

Long time calculation

Post by Alexis »

Hello everyone,

I have a problem with my new PC. When I render a rendering, the preparation phase is very long, sometimes longer than the rendering in itself. 3-4 min for preparation GI, less than one minute for rendering and 2-3 min for the "antibanding" phase after the 100%

If I cancel the rendering I sometimes have to wait 8-10 min before I can return to the layout.

It does on all my kray scenes.

You have an idea?

Thank you


Bonjour à tous,

J'ai un problème avec mon nouveau PC. Quand je lance un rendu, la phase de préparation est très longue, parfois plus longue que le rendu en lui même. 3-4 min pour la préparation GI, moins d'une minute pour le rendu et 2-3 min pour la phase "antibanding" après les 100%

Si j'annule le rendu je dois parfois attendre 8-10 min avant de pouvoir retourner sur le layout.

ça le fait sur toutes mes scènes kray.

Vous avez une idée?

Merci
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Long time calculation

Post by Janusz Biela »

Probably deep recurse or instances problem.
Send me scene: janusz.biela@gmail.com via wetransfer (confidential of course) I will check.
User avatar
promity
Posts: 94
Joined: Sat Feb 24, 2007 4:49 pm
Location: Russia
Contact:

Re: Long time calculation

Post by promity »

Maybe it's related to this or that hardware - CPU, RAM, Motherboard, etc, as it was with me. Symptoms are very similar.
In my case - and I use engineering samples of processors - Gregorz had to add something to the code so that my processors could work in normal mode when rendering through K3.
Alexis
Posts: 71
Joined: Mon Aug 02, 2010 10:32 am
Location: France
Contact:

Re: Long time calculation

Post by Alexis »

Janusz Biela wrote:Probably deep recurse or instances problem.
Send me scene: janusz.biela@gmail.com via wetransfer (confidential of course) I will check.
You can dowload my 400 Go disk work? :D

I have this problem with big scene, over 1.5 million poly, many instance veget and objects and i suspect problemb with RAM instructions.

My hardware, bi xeon e5-2696 v3, Ram 4x16gb 2400 cl17 Ecc registered and parity, MB asus Z10PE-D8ws.

I render test frame (960x540 pixel), click on "render frame", 3min for loading and calcul kray, 40s "raytracing calcul" and 5min for return in layout for view render.. For simple texture test is very long.
Even .lws with my i7, I do not wait so long once the calculation is finished and the image go faster in raytracing calculation.

need bios parameter with this RAM ?

Thank you for help.
Alexis
Posts: 71
Joined: Mon Aug 02, 2010 10:32 am
Location: France
Contact:

Re: Long time calculation

Post by Alexis »

I test three scene with K3_rc1, no change compare K2.62, they all crash lightwave.
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Long time calculation

Post by Janusz Biela »

Alexis wrote:I test three scene with K3_rc1, no change compare K2.62, they all crash lightwave.
Please read Node infrmation what is not supported. Try use Kray3override plugin - disable Nodes there. If scene is running then you use not supported Nodes.
thibault
Posts: 57
Joined: Wed Nov 18, 2009 5:39 pm

Re: Long time calculation

Post by thibault »

Alexis wrote:I test three scene with K3_rc1, no change compare K2.62, they all crash lightwave.
Ok ! Disable nodes _ sun _ seems light too and pehaps, but i'm not sur, pehaps walls and windows ! After, it's ok !

:D :D :D :D :D :D :D :D
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Long time calculation

Post by Janusz Biela »

thibault wrote:
Alexis wrote:I test three scene with K3_rc1, no change compare K2.62, they all crash lightwave.
Ok ! Disable nodes _ sun _ seems light too and pehaps, but i'm not sur, pehaps walls and windows ! After, it's ok !

:D :D :D :D :D :D :D :D
Using K3 for big projects is quite risky yet. It can be some sort of bugs with memory management or strange things...
Please use only in small scenes.
Alexis
Posts: 71
Joined: Mon Aug 02, 2010 10:32 am
Location: France
Contact:

Re: Long time calculation

Post by Alexis »

Hi, I have just re-tested by comparing two PCs.
850pt in cinebench r15 for an i7 (win10 64 family) and 4500pt for the bi-xeon (win10 64 pro).

The same scene without "cache irradiance", 55min on i7 and 10min on the bi-xeon. It's OK

With "cache irradiance" and "shared for all frames" already calculated, 19min on i7 and 10min on the bi-xeon with idle processor !!

I do not understand anything anymore. I do not use plug-in, only classic nodes and classic lightwave surfaces.


I timed when I canceled a rendering in progress. 35s on the i7 and more than 6min on the bi-xeon!

Kray is not compatible with some CPU instruction? Or specification ram (ecc, parity, ...)?

Thank you
Attachments
Processor load with cache file on bi-xeon
Processor load with cache file on bi-xeon
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Long time calculation

Post by Janusz Biela »

Alexis wrote:Hi, I have just re-tested by comparing two PCs.
850pt in cinebench r15 for an i7 (win10 64 family) and 4500pt for the bi-xeon (win10 64 pro).

The same scene without "cache irradiance", 55min on i7 and 10min on the bi-xeon. It's OK

With "cache irradiance" and "shared for all frames" already calculated, 19min on i7 and 10min on the bi-xeon with idle processor !!

I do not understand anything anymore. I do not use plug-in, only classic nodes and classic lightwave surfaces.


I timed when I canceled a rendering in progress. 35s on the i7 and more than 6min on the bi-xeon!

Kray is not compatible with some CPU instruction? Or specification ram (ecc, parity, ...)?

Thank you
Do not use Final Gathering (cache) The risk of deep recurse is too big.
I forget Final Gathering 1.5 year ago.
Only QMC. With that hardware you do not need FG at all.
Now you will ask me how to share GI........ :mrgreen:
If you are interested in I will post procedures here.

btw of deep recurse.
Try add this command in Header Cmds:

Code: Select all

lwo2rayslimit 1,0.5;
btw#2
This is reason why I use QMC system: easy, fast, looks almost like Path Tracing.
Alexis
Posts: 71
Joined: Mon Aug 02, 2010 10:32 am
Location: France
Contact:

Re: Long time calculation

Post by Alexis »

Thanks for return,

It is for an animation, only cam move. With the QMC method (no cache), there are "splotch" in lighting.

I have 2000 frames to render by garagefarm, and their cpu are not as fast as mine. :mrgreen: big money for render...


Yes your procedure interests me :wink:
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Long time calculation

Post by Janusz Biela »

Alexis wrote:Thanks for return,

It is for an animation, only cam move. With the QMC method (no cache), there are "splotch" in lighting.

I have 2000 frames to render by garagefarm, and their cpu are not as fast as mine. :mrgreen: big money for render...


Yes your procedure interests me :wink:
I will try post it today.
General idea is that:
You can not save GI when you use PM+QMC because...doesn`t exists :mrgreen:
But you can save Photon Map solution - this is very small file with ONLY information about photon power and positions (a few kilobytes)
This PM solution will be later used like LOAD GI. Because QMC sampling is accurate in his nature behavior , differences between frames are very very little.
The most important is to have Photon Map solution without changing photons cells every frame. This protect you from flickering.
Each frame is render separately like still image loading this PM map created by you.
If I remember I tested this on GarageFarm - so it works. For network system it doesn`t matter what he loads: GI or PM solution.
Noise from render (because of QMC sampling) you can reduce in post process , just catch good balance level: noise/quality.
The quality of render is very close Path Tracing.
Of course whole system works slower but in some situations (complex scenes) you win with this.

artattak tested this in animation in complex scene (I did only synthetic) and even with big noise animation looks good.
Alexis
Posts: 71
Joined: Mon Aug 02, 2010 10:32 am
Location: France
Contact:

Re: Long time calculation

Post by Alexis »

Janusz Biela wrote: I will try post it today.
I'm looking forward to it! :wink:
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Long time calculation

Post by Janusz Biela »

Alexis wrote:
Janusz Biela wrote: I will try post it today.
I'm looking forward to it! :wink:
I created post here:
http://www.kraytracing.com/phpBB3/viewt ... f=4&t=5333
Locked