Jump to content


Photo

GPU Clients crashed


  • Please log in to reply
14 replies to this topic

#1 Renigade

Renigade

    Seminole

  • Folding Member
  • 682 posts
  • Gender:Male

Posted 08 December 2012 - 03:07 PM

Project P7626 on my x4 940 and 7625 on my X4 9850 BE
both GPU's are stalled
I tried to restart PC and clinet and Connection.
Stopped working after i set up my router and I had my problems with my new 16 port switch.. Net work problem?
Not even sure if this is the correct LOG
*********************** Log Started 2012-12-08T22:54:04Z ***********************
22:54:04:************************* Folding@home Client *************************
22:54:04:  	Website: http://folding.stanford.edu/
22:54:04:	Copyright: (c) 2009-2012 Stanford University
22:54:04:   	Author: Joseph Coffland <[email protected]>
22:54:04:     	Args: --lifeline 1656 --command-port=36330
22:54:04:   	Config: C:/Users/Jeff/AppData/Roaming/FAHClient/config.xml
22:54:04:******************************** Build ********************************
22:54:04:  	Version: 7.2.9
22:54:04:     	Date: Oct 3 2012
22:54:04:     	Time: 18:05:48
22:54:04:  	SVN Rev: 3578
22:54:04:   	Branch: fah/trunk/client
22:54:04: 	Compiler: Intel(R) C++ MSVC 1500 mode 1200
22:54:04:  	Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
22:54:04:           	/QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
22:54:04: 	Platform: win32 XP
22:54:04:     	Bits: 32
22:54:04:     	Mode: Release
22:54:04:******************************* System ********************************
22:54:04:      	CPU: AMD Phenom(tm) II X4 940 Processor
22:54:04:   	CPU ID: AuthenticAMD Family 16 Model 4 Stepping 2
22:54:04:     	CPUs: 4
22:54:04:   	Memory: 8.00GiB
22:54:04:  Free Memory: 6.28GiB
22:54:04:  	Threads: WINDOWS_THREADS
22:54:04:   On Battery: false
22:54:04:   UTC offset: -5
22:54:04:      	PID: 3628
22:54:04:      	CWD: C:/Users/Jeff/AppData/Roaming/FAHClient
22:54:04:       	OS: Windows 7 Home Premium
22:54:04:  	OS Arch: AMD64
22:54:04:     	GPUs: 1
22:54:04:    	GPU 0: ATI:4 Radeon HD 5800 Series (Cypress LE)
22:54:04:     	CUDA: Not detected
22:54:04:Win32 Service: false
22:54:04:***********************************************************************
22:54:04:Trying to access database...
22:54:04:Enabled folding slot 00: READY gpu:0:"Radeon HD 5800 Series (Cypress LE)"
22:54:04:Enabled folding slot 01: READY smp:4
22:54:04:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
22:54:04:WU00:FS01:Starting
22:54:04:WU00:FS01:Core PID:3536
22:54:04:WU00:FS01:FahCore 0xa4 started
22:54:04:ERROR:WU01:FS00:Exception: Failed to access core package.
22:54:04:WU00:FS01:0xa4:
22:54:04:WU00:FS01:0xa4:*------------------------------*
22:54:04:WU00:FS01:0xa4:Folding@Home Gromacs GB Core
22:54:04:WU00:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
22:54:04:WU00:FS01:0xa4:
22:54:04:WU00:FS01:0xa4:Preparing to commence simulation
22:54:04:WU00:FS01:0xa4:- Looking at optimizations...
22:54:04:WU00:FS01:0xa4:- Files status OK
22:54:04:WU00:FS01:0xa4:- Expanded 2079474 -> 5386224 (decompressed 259.0 percent)
22:54:04:WU00:FS01:0xa4:Called DecompressByteArray: compressed_data_size=2079474 data_size=5386224, decompressed_data_size=5386224 diff=0
22:54:05:WU00:FS01:0xa4:- Digital signature verified
22:54:05:WU00:FS01:0xa4:
22:54:05:WU00:FS01:0xa4:Project: 7809 (Run 2, Clone 50, Gen 77)
22:54:05:WU00:FS01:0xa4:
22:54:05:WU00:FS01:0xa4:Assembly optimizations on if available.
22:54:05:WU00:FS01:0xa4:Entering M.D.
22:54:10:WU00:FS01:0xa4:Using Gromacs checkpoints
22:54:10:WU00:FS01:0xa4:Mapping NT from 4 to 4 
22:54:11:WU00:FS01:0xa4:Resuming from checkpoint
22:54:11:WU00:FS01:0xa4:Verified 00/wudata_01.log
22:54:11:WU00:FS01:0xa4:Verified 00/wudata_01.trr
22:54:11:WU00:FS01:0xa4:Verified 00/wudata_01.xtc
22:54:11:WU00:FS01:0xa4:Verified 00/wudata_01.edr
22:54:11:WU00:FS01:0xa4:Completed 931590 out of 1500000 steps  (62%)
22:55:04:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
22:55:04:ERROR:WU01:FS00:Exception: Failed to access core package.
22:56:41:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
22:56:41:ERROR:WU01:FS00:Exception: Failed to access core package.
22:58:25:FS00:Finishing
22:58:25:FS01:Finishing
22:59:18:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
22:59:19:ERROR:WU01:FS00:Exception: Failed to access core package.
23:03:33:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
23:03:33:ERROR:WU01:FS00:Exception: Failed to access core package.
23:10:24:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
23:10:24:ERROR:WU01:FS00:Exception: Failed to access core package.
23:13:00:WU00:FS01:0xa4:Completed 945000 out of 1500000 steps  (63%)
23:21:30:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
23:21:30:ERROR:WU01:FS00:Exception: Failed to access core package.
23:32:18:WU00:FS01:0xa4:Completed 960000 out of 1500000 steps  (64%)
23:39:26:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
23:39:27:ERROR:WU01:FS00:Exception: Failed to access core package.
23:51:34:WU00:FS01:0xa4:Completed 975000 out of 1500000 steps  (65%)
00:08:29:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:08:29:ERROR:WU01:FS00:Exception: Failed to access core package.
00:09:49:Saving configuration to config.xml
00:09:55:FS01:Shutting core down
00:09:58:Clean exit
*********************** Log Started 2012-12-09T00:10:00Z ***********************
00:10:00:************************* Folding@home Client *************************
00:10:00:  	Website: http://folding.stanford.edu/
00:10:00:	Copyright: (c) 2009-2012 Stanford University
00:10:00:   	Author: Joseph Coffland <[email protected]>
00:10:00:     	Args: --lifeline 1656 --command-port=36330
00:10:00:   	Config: C:/Users/Jeff/AppData/Roaming/FAHClient/config.xml
00:10:00:******************************** Build ********************************
00:10:00:  	Version: 7.2.9
00:10:00:     	Date: Oct 3 2012
00:10:00:     	Time: 18:05:48
00:10:00:  	SVN Rev: 3578
00:10:00:   	Branch: fah/trunk/client
00:10:00: 	Compiler: Intel(R) C++ MSVC 1500 mode 1200
00:10:00:  	Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
00:10:00:           	/QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
00:10:00: 	Platform: win32 XP
00:10:00:     	Bits: 32
00:10:00:     	Mode: Release
00:10:00:******************************* System ********************************
00:10:00:      	CPU: AMD Phenom(tm) II X4 940 Processor
00:10:00:   	CPU ID: AuthenticAMD Family 16 Model 4 Stepping 2
00:10:00:     	CPUs: 4
00:10:00:   	Memory: 8.00GiB
00:10:00:  Free Memory: 6.25GiB
00:10:00:  	Threads: WINDOWS_THREADS
00:10:00:   On Battery: false
00:10:00:   UTC offset: -5
00:10:00:      	PID: 1628
00:10:00:      	CWD: C:/Users/Jeff/AppData/Roaming/FAHClient
00:10:00:       	OS: Windows 7 Home Premium
00:10:00:  	OS Arch: AMD64
00:10:00:     	GPUs: 1
00:10:00:    	GPU 0: ATI:4 Radeon HD 5800 Series (Cypress LE)
00:10:00:     	CUDA: Not detected
00:10:00:Win32 Service: false
00:10:00:***********************************************************************
00:10:00:Trying to access database...
00:10:00:Enabled folding slot 00: READY gpu:0:"Radeon HD 5800 Series (Cypress LE)"
00:10:00:Enabled folding slot 01: READY smp:2
00:10:00:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:10:00:WU00:FS01:Starting
00:10:00:WARNING:WU00:FS01:Changed SMP threads from 4 to 2 this can cause some work units to fail
00:10:00:WU00:FS01:Core PID:3956
00:10:00:WU00:FS01:FahCore 0xa4 started
00:10:01:ERROR:WU01:FS00:Exception: Failed to access core package.
00:10:01:WU00:FS01:0xa4:
00:10:01:WU00:FS01:0xa4:*------------------------------*
00:10:01:WU00:FS01:0xa4:Folding@Home Gromacs GB Core
00:10:01:WU00:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
00:10:01:WU00:FS01:0xa4:
00:10:01:WU00:FS01:0xa4:Preparing to commence simulation
00:10:01:WU00:FS01:0xa4:- Looking at optimizations...
00:10:01:WU00:FS01:0xa4:- Files status OK
00:10:01:WU00:FS01:0xa4:- Expanded 2079474 -> 5386224 (decompressed 259.0 percent)
00:10:01:WU00:FS01:0xa4:Called DecompressByteArray: compressed_data_size=2079474 data_size=5386224, decompressed_data_size=5386224 diff=0
00:10:01:WU00:FS01:0xa4:- Digital signature verified
00:10:01:WU00:FS01:0xa4:
00:10:01:WU00:FS01:0xa4:Project: 7809 (Run 2, Clone 50, Gen 77)
00:10:01:WU00:FS01:0xa4:
00:10:01:WU00:FS01:0xa4:Assembly optimizations on if available.
00:10:01:WU00:FS01:0xa4:Entering M.D.
00:10:07:WU00:FS01:0xa4:Using Gromacs checkpoints
00:10:07:WU00:FS01:0xa4:Mapping NT from 2 to 2 
00:10:08:WU00:FS01:0xa4:Resuming from checkpoint
00:10:08:WU00:FS01:0xa4:Verified 00/wudata_01.log
00:10:08:WU00:FS01:0xa4:Verified 00/wudata_01.trr
00:10:08:WU00:FS01:0xa4:Verified 00/wudata_01.xtc
00:10:08:WU00:FS01:0xa4:Verified 00/wudata_01.edr
00:10:08:WU00:FS01:0xa4:Completed 984730 out of 1500000 steps  (65%)
00:11:01:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:11:01:ERROR:WU01:FS00:Exception: Failed to access core package.
00:12:38:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:12:38:ERROR:WU01:FS00:Exception: Failed to access core package.
00:15:15:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:15:15:ERROR:WU01:FS00:Exception: Failed to access core package.
00:19:29:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:19:30:ERROR:WU01:FS00:Exception: Failed to access core package.
00:23:02:WU00:FS01:0xa4:Completed 990000 out of 1500000 steps  (66%)
00:26:21:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:26:21:ERROR:WU01:FS00:Exception: Failed to access core package.
00:37:26:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:37:26:ERROR:WU01:FS00:Exception: Failed to access core package.
00:55:23:WU01:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_15.fah
00:55:23:ERROR:WU01:FS00:Exception: Failed to access core package.
00:59:39:WU00:FS01:0xa4:Completed 1005000 out of 1500000 steps  (67%)
Any Ideas? how do I trouble shoot this problem to get my GPU's back to folding?

Edited by Renigade, 08 December 2012 - 05:29 PM.


#2 Renigade

Renigade

    Seminole

  • Folding Member
  • 682 posts
  • Gender:Male

Posted 08 December 2012 - 03:11 PM

Should I try to Re-Install?
just dont understand why it would fail on both PCs

#3 Renigade

Renigade

    Seminole

  • Folding Member
  • 682 posts
  • Gender:Male

Posted 08 December 2012 - 05:13 PM

I am on Skype if anyone has time to help me tonight
Renegade_Nole

#4 Hyper

Hyper

    Of course it will fit, I have power tools.

  • Members
  • PipPipPip
  • 887 posts
  • Gender:Male
  • Location:Vancouver, WA

Posted 08 December 2012 - 05:14 PM

When the gpu client faults out on mine I usually just stop the client and close it, then restart it and it continues the cpu one picks up where it left off and the gpu picks up a new wu.. My gtx480 doesnt like some of the wu's, havent seen any issues with my 580's though (or the gtx285 for that matter).

You using the console client?
Posted Image

#5 Renigade

Renigade

    Seminole

  • Folding Member
  • 682 posts
  • Gender:Male

Posted 08 December 2012 - 05:30 PM

using FAHControl
I have restarted but nothing. Even Rebooted the machine

#6 Renigade

Renigade

    Seminole

  • Folding Member
  • 682 posts
  • Gender:Male

Posted 08 December 2012 - 05:38 PM

Posted Image

#7 ccokeman

ccokeman

    Frank <3 Reesa

  • Reviewer
  • PipPipPipPipPipPipPip
  • 11511 posts
  • Gender:Male

Posted 08 December 2012 - 08:18 PM

Mine did the same thing. Crashed an no recovery. Removed the GPU client and re added it without any luck so I just reverted back to the old clients
Processor Intel Core I7 920 @ 3.6
Memory Mushkin 998995 Blackline 12GB 9-9-9-24
Motherboard MSI X58 Big Bang
Graphics ASUS GTX 580
Power Corsair AX 1200,
Monitor Gateway UXD3000, LG W3000H, ASUS VG236 x 3
Water Cooling By DangerDen & Swiftech
Follow OCC on Posted Image

#8 Braegnok

Braegnok

    Ghillie in the Mist

  • Folding Member
  • 540 posts
  • Gender:Male
  • Location:Colorado USA

Posted 09 December 2012 - 04:56 AM

Should I try to Re-Install?
just dont understand why it would fail on both PCs

That's vary strange, My Folding rig GPU's crashed yesterday also, and I have been trying to get them to restart all last night.
The damn things will not update? But the SMP is running fine :dunno: I'm at 40% on my SMP work order, and just paused, quit , I do not want to loose the folding points for SMP,
so I guess I'll let it Finnish, and uninstall F@H then reload. unless someone has a fix?

i7-4790K

Maximus VII Gene

GTX Titan Black 6GD5

G.SKILL 4X4GB 3200MHz

Corsair AX760i

Corsair Obsidian 450D

Cooling by Black Ice & EK 

 

                    


#9 bandwith

bandwith

    Member

  • Folding Member
  • 99 posts
  • Gender:Male
  • Location:Atlanta, GA, USA, Earth

Posted 09 December 2012 - 05:35 AM

Did you check to verify the new core downloaded? I've had loads of problems being on a native IPv6 network.

#10 road-runner

road-runner

    Posting Machine

  • Folding Member
  • 10734 posts
  • Gender:Male
  • Location:Texas

Posted 09 December 2012 - 05:39 AM

I think I read yesterday or day before there was or is some server issues at stanford assigning wrong WUs or something another check the folding forum...

sigimage.gif


#11 Renigade

Renigade

    Seminole

  • Folding Member
  • 682 posts
  • Gender:Male

Posted 09 December 2012 - 05:55 AM

I think I read yesterday or day before there was or is some server issues at stanford assigning wrong WUs or something another check the folding forum...

I posted on the Folding forum asking how to fix it

Edited by Renigade, 09 December 2012 - 07:18 AM.


#12 Renigade

Renigade

    Seminole

  • Folding Member
  • 682 posts
  • Gender:Male

Posted 09 December 2012 - 07:18 AM

well when they figure it out I will start folding again