Atlas Performance and Compatibility Test Bench

From WorldForgeWiki
Jump to: navigation, search

When porting Atlas to new technology or evaluating an existing implementation it is necessary to be able to measure the standard compliance. Atlas performance and compatibility test bench is a tool or set of tools which can be used to execute this kind of evaluation in timely manner and achieve concrete results. The test bench functionality can be divided to two areas: client evaluation and server evaluation.

Contents

Common Evaluation

  • Compatibility
    • Codec (Bach, Packed, XML...)
    • Protocol
      • Version
      • Conversations (Named Operation Sets: Login, Game Management, Avatar Management, Crafting, Medieval Melee)
  • Performance (Relative to reference implementation in the same computer).
    • Maximum send rate
    • Maximum receive rate
    • Maximum message encoded rate
    • Maximum message decode rate

Client Evaluation

Server Evaluation

  • Performance
    • Simultaneous client count versus receive/send rate per client

Automatically Generated Score Chart Proposal

Codec    | Is Compatible
---------+----------------
Bach     |
XML      |
Packed   |      X

             |          Version
Conversation | 1.0 | 1.3 | 1.5 | 2.0
-------------+----------------------
Login        |  X  |     |     |    
Game Manag.  |  X  |     |     |    
Avatar Manag.|     |     |     |

Performance Class: Very Low (1) / Low (2) / Medium (3) / High (4) / Very High(5)
Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox