CALIPER

Project

2022 Q4 Hyperledger Caliper

2022 Q3 Hyperledger Caliper

2022 Q2 Hyperledger Caliper

Caliper

2021 Q4 Hyperledger Caliper

2021 Q3 

Current Plans

  • Finish, integrate, and document the HL Mentorship project. Reach out to the community for feedback.
  • Implement the common repo requirements.
  • Migrate the CI/CD pipeline from Azure to GitHub Actions.
  • Make the orchestration, communication, and round execution of worker services more flexible to allow for more complex benchmark implementations.


2021 Q2 Hyperledger Caliper

Current Plans

  • Compliance with common repo requirements
  • Addressing the above-mentioned issues (current code quality still makes first contributions a challenge)
  • Improve user (workload implementation) experience, done in the context of a mentorship project

Maintainer Diversity

Attila Klenik: Maintainer
Nick Lincoln: Maintainer
Dave Kelsey: Contributor



2021 Q1 Hyperledger Caliper

Badge level for project 2381 is passing

3/29/2021

11/30


    
 BEST PRACTICE BADGE

White Paper

Graphic Set:

Webinars

Self Paced Training

Instructor Led Training

Code on

Github 

MOOC

Section

Presentations:

Technical /
Non-technical

Use Cases

CALIPER

·         

·         

·         






Caliper is a blockchain benchmark framework which allows users to measure the performance of a specific blockchain implementation with a set of predefined use cases. Caliper will produce reports containing a number of performance indicators, such as TPS (Transactions Per Second), transaction latency, resource utilisation etc. The intent is for Caliper results to be used as a reference in supporting the choice of a blockchain implementation suitable for the user-specific use-cases. Given the variety of blockchain configurations, network setup, as well as the specific use-cases in mind, it is not intended to be an authoritative performance assessment, nor to be used for simple comparative purposes (e.g. blockchain A does 5 TPS and blockchain B does 10 TPS, therefore B is better). The Caliper project references the definitions, metrics, and terminology as defined by the Performance & Scalability Working Group (PSWG).

Key Characteristics

  • A unified blockchain benchmark framework. We provide a common layer to integrate with major existing blockchain framework/platforms, so that the same benchmarks can be run for different blockchain systems Some benchmark test environment will be provided to help different people run tests under the same environment, blockchain management tools like Hyperledger Cello could be integrated later to deploy and operate the environment. Also, users can use their existing environment and configure Caliper to run the test under the environment.

  • A commonly accepted definition of performance indicators. You cannot compare an apple and a pear directly unless some common criteria are set. We will work closely with PSWG to provide a common definition of performance indicators that users care about, such as TPS, latency, resource utilization, etc.

  • A set of commonly accepted benchmark cases. The goal of Caliper includes providing a set of easy-understandable benchmark cases so that each blockchain solution can be compared in various scenarios. This calls for much collaboration from PSWG, Requirement WG and other WG in Hyperledger community as well as blockchain practitioners to cover as many use cases that are of user’s interest as possible.

Project Management

Issue Tracking - https://github.com/hyperledger/caliper/issues

Repositories

Source code: https://github.com/hyperledger/caliper

Documentation: https://hyperledger.github.io/caliper/

Additional Materials

License Scan Results


Security Audit

When Hyperledger Caliper reaches their first major release, Hyperledger will execute an external security audit of the code.

License Audit

2019-03 Caliper License Audit Summary

2019-03 Caliper License Audit Full Report

License Audit Fixes

Hyperledger Caliper License Github Issues

Crypto Audit

Hyperledger Export Notice

https://www.hyperledger.org/projects/caliper