KEYWORDS: Video, Video surveillance, Video processing, Video compression, Prototyping, Multimedia, Signal to noise ratio, Data processing, Computer programming, Mobile devices
As multimedia-capable, network-enabled devices become ever more abundant, device heterogeneity and resource sharing
dynamics remain difficult challenges in networked continuous media applications. These challenges often cause the
applications to exhibit very brittle real-time performance. Due to heterogeneity, minor variations in encoding can mean
a continuous media item performs well on some devices but very poorly on others. Resource sharing can mean that
content can work for some of the time, but real-time delivery is frequently interrupted due to competition for resources.
Quality-adaptive approaches seek to preserve real-time performance, by evaluating and executing trade-offs between the
quality of application results and the resources required and available to produce them. Since the approach requires the
applications to adapt the results they produce, we refer to them as elastic real-time applications. In this paper, we use
video as a specific example of an elastic real-time application. We describe a general strategy for CPU adaptation called
Priority-Progress adaptation, which compliments and extends previous work on adaptation for network bandwidth. The
basic idea of Priority-Progress is to utilize priority and timestamp attributes of the media to reorder execution steps, so that
low priority work can be skipped in the event that the CPU is too constrained to otherwise maintain real-time progress.
We have implemented this approach in a prototype video application. We will present benchmark results that demonstrate
the advantages of Priority-Progress adaptation in comparison to techniques employed in current popular video players.
These advantages include better timeliness as CPU utilization approaches saturation, and more user-centric control over
quality-adapation (for example to boost the video quality of selected video in a multi-video scenario). Although we focus
on video in this paper, we believe that the Priority-Progress technique is applicable to other multimedia and other real-time
applications, and can similarly help them address the challenges of device heterogenity and dynamic resource sharing.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.