Jump to content


Photo
- - - - -

How would you Benchmark a cloud gaming service?


  • Please log in to reply
8 replies to this topic

#1 NCC10281982B

NCC10281982B

    The useless guy™

  • Moderator
  • PipPipPipPipPipPip
  • 6986 posts
  • Gender:Male
  • Location:Bellevue, WA

Posted 18 December 2014 - 02:55 PM

For a while not I have been curious about performance differences between services like onelive and running a game locally.

Knowing that there are more factors at play in the cloud situation than system specs & FPS. I'd like some opinions on how a person could go about benchmarking and comparing the two options.

 

If I where writing a compression article I would ask myself: "why would I spend X#& on hardware + the cost of the game when I can "rent" it? Or vis a visa?

 

I'm tempted to buy Just Cause 2 (it's the only onlive game I have, waiting for JC3), on steam so I could do an "apples to apples" FPS compression but I am kinda poor right now. Long story.

 

Thought?


I am DUMB, okay? Dumb as a post! Think I'm happy about it?
 
sigimage.gifCFr15LujaQwHZgiAc222zw.png

#2 IVIYTH0S

IVIYTH0S

    They call me... General Help.

  • Members
  • PipPipPipPipPipPipPipPip
  • 21620 posts
  • Gender:Male
  • Location:South, NJ

Posted 18 December 2014 - 05:22 PM

Hmm...Wouldn't frames be frames for what you see?


"GilliumX58" DESKTOP
Mobo: Asus P8Z68-V-PRO | Processor: Intel Core i7 2600K @ 4.6ghz | CPU Cooler: Zalman CNPS9900MAXR | Videocard: ASUS GTX970 Strix
Memory: Patriot/Kingston 16GB 1866mhz | OS SSD: SanDisk Extreme 240GB SATA | PSU: PC Power & Cooling Silencer 750W
Monitor: Samsung 30" 305T | CD/DVD: Samsung SH-S223F | Keyboard: Sentey Phoenix | Mouse: Razer Lachesis

OCC Cool Club Member

 
 

Rebate Success Thread 2015---RMA Success Thread 2016---GPU Comparison tool on AnAndTech


#3 DanTheGamer11

DanTheGamer11

    Proud noob

  • Members
  • PipPipPipPipPip
  • 4403 posts
  • Gender:Male

Posted 18 December 2014 - 07:53 PM

Input latency? dunno


Processor AMD Phenom II X6 1055T @3.2Ghz
Cooler Cooler Master Hyper 212 Evo
Memory 8GB 1.48V 1600Mhz DDR3 Crucial Ballistix Tactical
Motherboard Asrock N68C-GS FX
Graphics XFX HD 7950
Storage 1TB WD Caviar Blue HDD, 240GB Kingston Hyper X SSD, Thanks OCC & Kingston, makes a big difference  :)
Optical Disk Drive Sony Optiarc DVD/CD ReWriter
Power Supply Cooler Master GX 650W Bronze
Case Cooler Master CM690, Akasa 4 port USB front panel (MOAR USBs  :woot:)


#4 Waco

Waco

    Lab Rat 2

  • Members
  • PipPipPipPipPipPipPipPip
  • 16508 posts
  • Gender:Male
  • Location:Los Alamos, NM

Posted 18 December 2014 - 08:36 PM

Latency is the biggest issue by far. If you're playing a non-latency sensitive game it doesn't matter if it's local or remote.

Tolerance is a sign of weakness.


#5 ir_cow

ir_cow

    I Am A Cow...

  • Reviewer
  • PipPipPipPipPipPip
  • 6276 posts
  • Gender:Male
  • Location:MT

Posted 18 December 2014 - 10:06 PM

I think the only major factor in cloud gaming is Latency / Ping.  Past that you are getting 1080p video compressed to your screen. It's not bad but It's not going to look as good. If you factor in the cost of a gaming pc. It could be worth it for a services like $30 a month.

 

Didn't we have this a while ago called OnLive or something?


Filckr Photostream / Intel Pentium G3258 OC Guide / NVIDIA GTX 1080 OC Guide

Main Rig: i7 3960X @ 4.3Ghz, ASUS X79 R4BE, 3x Geforce GTX 1080Ti, Intel 730(s) 480GB, 64GB DDR3 1600, Seasonic 1000w Plat.

Review Test Rig: : i7-4770k @ 4.2ghz, MSI-GD65 Gaming, Geforce GTX 770 , Corsair Force GT 240 GB, Patriot 16 GB 2400 (2x8gb), Thermaltake 750w.


#6 NCC10281982B

NCC10281982B

    The useless guy™

  • Moderator
  • PipPipPipPipPipPip
  • 6986 posts
  • Gender:Male
  • Location:Bellevue, WA

Posted 19 December 2014 - 07:17 PM

Okay, so latency is the obvious major factor. The requirements for the service also want a 5Mb/s downstream rate. I know the Onlive client measures this while connecting. But if I wanted to experiment / tesyt that on my own I do not know how to do that. if the net_graph command existed I would obviously use that. 


I am DUMB, okay? Dumb as a post! Think I'm happy about it?
 
sigimage.gifCFr15LujaQwHZgiAc222zw.png

#7 Braegnok

Braegnok

    Nimrod

  • Folding Member
  • 1432 posts
  • Gender:Male
  • Location:Colorado USA

Posted 20 December 2014 - 04:15 AM

Both the ping and tracert commands measure your internet latency.  You could ping the sites IP address or domain name.


Edited by Braegnok, 22 December 2014 - 04:05 AM.

Intel Core i7-8700K

Asus Maximus X Apex

Corsair 16GB 3200MHz

Asus GTX 1080 Ti FE 

SeaSonic SSR-850TR

Corsair Hydro H115i


#8 NCC10281982B

NCC10281982B

    The useless guy™

  • Moderator
  • PipPipPipPipPipPip
  • 6986 posts
  • Gender:Male
  • Location:Bellevue, WA

Posted 21 December 2014 - 04:53 PM

Thanks. I know of those commands (MCSA) bu tI would want to mesure the metrics ageist the onlive servers (I don't know the IP). Speet test between here and seattle is something like 9ms so I am inclined to thing that my "last mile" is golden :)


Another point is the cost analysis of all this. In the case of JC2, several mods are included as part of the services package. These same mods would have to be purchased from steam


Another thing, this is what the compressed 1080p video looks like. Granted my monitors max res is 1920x1080 I still wonder if local would be better assuming the game allows for modifying MSAA and such.

Attached Thumbnails

  • OnLive 2015-01-06 21-33-07-49.png
  • OnLive 2015-01-06 21-31-03-49.png

I am DUMB, okay? Dumb as a post! Think I'm happy about it?
 
sigimage.gifCFr15LujaQwHZgiAc222zw.png

#9 NCC10281982B

NCC10281982B

    The useless guy™

  • Moderator
  • PipPipPipPipPipPip
  • 6986 posts
  • Gender:Male
  • Location:Bellevue, WA

Posted 27 January 2015 - 08:01 PM

I just fired up JC2 via onlive. The game maxes out at 30 FPS. I have seen 50 - 60 as recentally as yesterday. I am also noticing jaggies and what seems to be reduced draw distance. My guess is Server load and or time of day could also be factors.


I am DUMB, okay? Dumb as a post! Think I'm happy about it?
 
sigimage.gifCFr15LujaQwHZgiAc222zw.png