MediaBench II Benchmark

Benchmark Suites:

Overview of MediaBench II benchmark organization

Links to the individual benchmark suites

• Composite
• Video & Image
• Audio
• Speech
• Security
• Graphics
• Analysis
• Kernels

Composite

The composite benchmark, MBcomp, suite will contain 1 or 2 of the most advanced applications from each of the individual media benchmarks (except Kernels).

Because MBcomp is made up of the other media-centric benchmark suites, it will not become fully available until all 6 of the media-centric benchmarks have been fully defined.

H.264: mb2_vid_h264.tgz
JPEG-2000: mb2_vid_jpg2000.tgz

Video & Image

Note: Updated versions of the video benchmarks were posted on 8/24/06, with corrected OProfile results and scripts.

This image- and video-centric media benchmark suite is composed of the encoders and decoders from six image/video compression standards: JPEG, JPEG-2000, H.263, H.264, MPEG-2, and MPEG-4. The corresponding list of benchmarks is: cjpeg, djpeg, h263dec, h263enc, h264dec, h264enc, jpg2000dec, jpg2000enc, mpeg2dec, mpeg2enc, mpeg4dec, and mpeg4enc.

Download source code, data, & scripts for all video benchmarks: mb2_video.tgz

H.264/MPEG-4 AVC:      (wiki)

Download all source code, data, & scripts for H.264: mb2_vid_h264.tgz
Source code: JM H.264/MPEG-4 reference software, version 10.2 - jm10.2.zip
Source code author(s): Karsten Sühring and Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG
OProfile execution results:

H.264 encoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs
H.264 decoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs

Interesting link: Second Annual MSU MPEG-4 AVC/H.264 Video Codec Comparison (Dec. '05)

MPEG-4 ASP:      (wiki)

Download all source code, data, & scripts for MPEG-4: mb2_vid_mpeg4.tgz
Source code: FFmpeg, SVN snapshot from April 24, 2006 - ffmpeg.2006_04_24.tgz
Source code author(s): FFMPEG Multimedia System
OProfile execution results:

MPEG-4 encoder with MMX/SSE:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs
MPEG-4 encoder without MMX/SSE:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs
MPEG-4 decoder with MMX/SSE:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs
MPEG-4 decoder without MMX/SSE:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs

Interesting link: MSU MPEG-4 SP/ASP Codecs Comparison

JPEG-2000:      (wiki)

Download all source code, data, & scripts for JPEG-2000: mb2_vid_jpg2000.tgz
Source code: Jasper, version 1.701.0 - jasper-1.701.0.zip
Source code author(s): The JasPer Project
OProfile execution results:

JPEG-2000 encoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs
JPEG-2000 decoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs

Interesting link: MSU JPEG 2000 Image Codecs Comparison (Sept. '05)

MPEG-2:      (wiki)

Download all source code, data, & scripts for MPEG-2: mb2_vid_mpeg2.tgz
Source code: MSSG, version 1.2 - mpeg2vidcodec_v12.tar.gz
Source code author(s): MPEG Software Simulations Group (MSSG)
OProfile execution results:

MPEG-2 encoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs
MPEG-2 decoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs

Interesting link: MPEG-2 Video Decoders Comparison

H.263:      (wiki)

Download all source code, data, & scripts for H.263: mb2_vid_h263.tgz
Source code:
tmn H.263 decoder, version 1.7 - tmndec-1.7.tar.gz
tmn H.263 encoder, version 1.7 - tmn-1.7.tar.gz
Source code author(s): Telenor R&D
OProfile execution results:

H.263 encoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs
H.263 decoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs

JPEG:      (wiki)

Download all source code, data, & scripts for JPEG: mb2_vid_jpeg.tgz
Source code: jpegsrc, version 6b - jpegsrc.v6b.tar.gz
Source code author(s): Independent JPEG Group (IJG)
OProfile execution results:

JPEG encoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs
JPEG decoder:
statistical results over 30 back-to-back runs
statistical results over 30 round-robin runs

Interesting link: MSU JPEG 2000 Image Codecs Comparison (Spt. '05)

These benchmarks are currently provided only in their original source code format, along with the OProfile scripts for profiling them on x86 Linux machines. We are looking for your help in formatting the benchmarks for the popular simulation and compilation environments, such as Simplescalar.

Audio

Will be posted soon

Speech

Still under development.

Any suggestions you may have regarding applications for inclusion in this benchmark suite would be appreciated.

Security

Still under development.

Any suggestions you may have regarding applications for inclusion in this benchmark suite would be appreciated.

Analysis       (e.g. Computer Vision, Character Recognition, etc.)

Still under development.

Any suggestions you may have regarding applications for inclusion in this benchmark suite would be appreciated.

Kernels

This will be the last benchmark suite to be developed, and will not be included as part of the composite benchmark suite.

As opposed to the other benchmark suites, which all contain full applications, this benchmark suite will consist of kernels that commonly appear in multimedia applications (e.g. DCT, motion estimation, etc.).