kc3-lang/avir/README.md
Tag
-
Show log
Commit
-
Hash : 5a12d43a
Author :
Date : 2015-10-14T23:20:59
Implemented "float4" SIMD data type support that offers 10-50% performance boost. Added abstraction layer for scanline processing functions. Added abstraction layer for dithering. Added 0th order filter bank for better 8-bit resizing performance. Optimized interpolation filter's quality. Improved default image resizer parameter sets. Optimized half-band filter used for 8X downsizing. Optimized correction filter used during upsizing.
AVIR
Introduction
Me, Aleksey Vaneev, is happy to offer you an open source image resizing library which has reached a production level of quality, and is ready to be incorporated into any project. This library features routines for both down- and upsizing of 8- and 16-bit, 1 to 4-channel images. Image resizing routines were implemented in multi-platform C++ code, and have a high level of optimality. Beside resizing, this library offers a sub-pixel shift operation.
The resizing algorithm at first produces 2X upsized image (relative to the source image size, or relative to the destination image size if downsizing is performed) and then performs interpolation using a bank of sinc function-based fractional delay filters. On the last stage a correction filter is applied which fixes smoothing introduced on previous steps.
An important element utilized by this algorithm is the so called Peaked Cosine window function, which is applied over sinc function in all filters. Please consult the documentation for more details.
AVIR is devoted to women. Your digital photos can look good at any size!
Requirements
C++ compiler and system with efficient “float” floating point (24-bit mantissa) type support. This library can also internally use the “double” and SIMD floating point types during resizing if needed. This library does not have dependencies beside the standard C library.
Links
Usage Information
The image resizer is represented by the avir::CImageResizer<> class, which is a single front-end class for the whole library. You do not basically need to use nor understand any other classes beside this class.
The code of the library resides in the “avir” C++ namespace, effectively isolating it from all other code. The code is thread-safe. You need just a single resizer object per running application, at any time, even when resizing images concurrently.
To resize images in your application, simply add 3 lines of code:
-
include “avir.h”
- avir :: CImageResizer<> ImageResizer( 8 );
- ImageResizer.resizeImage( … ); (multi-threaded operation requires additional coding, see the documentation)
The library is able to process images of any bit depth: this includes 8-bit, 16-bit, float and double types. Larger integer and signed integer types are not supported. Supported source and destination image sizes are up to 2.1 gigapixels (46300x46300 or equivalent dimensions, e.g. 53467x40100).
The code of this library was commented in the Doxygen style. To generate the documentation locally you may run the “doxygen ./other/avirdoxy.txt” command from the library’s directory. Note that the code was suitably documented allowing you to make modifications, and to gain full understanding of the algorithm.
Preliminary tests show that this library can resize 8-bit RGB 5184x3456 (17.9 Mpixel) image down to 1037x691 (0.7 Mpixel) image in 355 milliseconds, utilizing a single thread, on a typical Intel Core i7-4770K processor-based system without overclocking. This scales down to 110 milliseconds if 4 threads are utilized. This time can be reduced further down to 80 milliseconds by utilizing SIMD floating point type. This library’s performance has a big potential to grow together with evolving processor architectures as currently performance is clearly limited by memory bandwidth, not by algorithm’s overhead.
Multi-threaded operation is not provided by this library “out of the box”. The multi-threaded infrastructure is fully available, but requires additional system-specific interfacing code for engagement.
SIMD Usage Information
This library is capable of using SIMD floating point types for internal variables. This means that up to 4 color channels can be processed in parallel. For example, this gives 40% performance boost when downsizing 3-channel images. During upsizing the boost is limited to 12%, but is still significant. Since the processing algorithm itself remains non-SIMD, the use of SIMD types is not practical for 1-channel image resizing (due to overhead). SIMD type can be used this way:
-
include “avir_float4_sse.h”
- avir :: CImageResizer< avir :: fpclass_float4 > ImageResizer( 8 );
Notes
This library was tested for compatibility with GNU C++, Microsoft Visual C++ and Intel C++ compilers, on 32- and 64-bit Windows, Mac OS X and CentOS Linux. The code was also tested with Dr.Memory/Win32 for the absence of uninitialized or unaddressable memory accesses.
All code is fully “inline”, without the need to compile any source files. The memory footprint of the library itself is very modest, except that the size of the temporary image buffers depends on the input and output image sizes, and is proportionally large.
The “heart” of resizing algorithm’s quality resides in the parameters defined via the avir::CImageResizerParams structure. While the default set of parameters that offers a good quality was already provided, there is still a place for improvement exists, and the default parameters may change in a future update. If you need to recall an exact set of parameters, simply save them locally for a later use.
When the algorithm is run with no resizing applied (k=1), the result of resizing will not be an exact copy of the source image: a very small amount of non-pronounced ringing artifacts, especially around sharp features like screen fonts should be expected. The reason for this is that the image is heavily low-pass filtered at first to reduce aliasing during subsequent resizing, and at last filtered by a correction filter that has a limited length and moderate steepness as to not cause ringing artifacts.
This library includes a binary command line tool “imageresize” for major desktop platforms. This tool was designed to be used as a demonstration of library’s performance and as a reference, it uses 4 threads and float4 SIMD internal type during processing. This tool uses the following libraries:
- turbojpeg Copyright (c) 2009-2013 D. R. Commander
- libpng Copyright (c) 1998-2013 Glenn Randers-Pehrson
- zlib Copyright (c) 1995-2013 Jean-loup Gailly and Mark Adler
Interpolation Discussion
The use of certain low-pass filters and 2X upsampling in this library is hardly debatable, because they are needed to attain a certain anti-aliasing effect and keep ringing artifacts low. But the use of sinc function-based interpolation filter that is 18 taps-long can be questioned, because even in 0th order case such interpolation filter requires 18 multiply-add operations. Comparatively, an optimal Hermit or cubic interpolation spline requires 8 multiply and 11 add operations.
One of the reasons 18-tap filter is preferred, is because due to memory bandwidth limitations using a lower-order filter does not provide any significant performance increase (e.g. 14-tap filter is less than 5% more efficient). At the same time, in comparison to cubic spline, 18-tap filter embeds a low-pass filter that rejects signal above 0.5*pi (provides additional anti-aliasing filtering), and this filter has a consistent shape at all fractional positions. Splines have a varying low-pass filter shape at different fractional positions (e.g. no low-pass filtering at 0.0 position, and maximal low-pass filtering at 0.5 position). 18-tap filter also offers a superior stop-band attenuation which almost guarantees absence of artifacts if the image is considerably sharpened afterwards.
Users
This library is used by:
Please drop me a note at aleksey.vaneev@gmail.com and I will include a link to your software product to the list of users. This list is important at maintaining confidence in this library among the interested parties.
Source
-
README.md
-
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145
# AVIR # ## Introduction ## Me, Aleksey Vaneev, is happy to offer you an open source image resizing library which has reached a production level of quality, and is ready to be incorporated into any project. This library features routines for both down- and upsizing of 8- and 16-bit, 1 to 4-channel images. Image resizing routines were implemented in multi-platform C++ code, and have a high level of optimality. Beside resizing, this library offers a sub-pixel shift operation. The resizing algorithm at first produces 2X upsized image (relative to the source image size, or relative to the destination image size if downsizing is performed) and then performs interpolation using a bank of sinc function-based fractional delay filters. On the last stage a correction filter is applied which fixes smoothing introduced on previous steps. An important element utilized by this algorithm is the so called Peaked Cosine window function, which is applied over sinc function in all filters. Please consult the documentation for more details. *AVIR is devoted to women. Your digital photos can look good at any size!* ## Requirements ## C++ compiler and system with efficient "float" floating point (24-bit mantissa) type support. This library can also internally use the "double" and SIMD floating point types during resizing if needed. This library does not have dependencies beside the standard C library. ## Links ## * [Documentation](http://avaneev.atspace.cc/avir/Documentation/) ## Usage Information ## The image resizer is represented by the **avir::CImageResizer<>** class, which is a single front-end class for the whole library. You do not basically need to use nor understand any other classes beside this class. The code of the library resides in the "avir" C++ namespace, effectively isolating it from all other code. The code is thread-safe. You need just a single resizer object per running application, at any time, even when resizing images concurrently. To resize images in your application, simply add 3 lines of code: * # include "avir.h" * avir :: CImageResizer<> ImageResizer( 8 ); * ImageResizer.resizeImage( ... ); (multi-threaded operation requires additional coding, see the documentation) The library is able to process images of any bit depth: this includes 8-bit, 16-bit, float and double types. Larger integer and signed integer types are not supported. Supported source and destination image sizes are up to 2.1 gigapixels (46300x46300 or equivalent dimensions, e.g. 53467x40100). The code of this library was commented in the [Doxygen](http://www.doxygen.org/) style. To generate the documentation locally you may run the "doxygen ./other/avirdoxy.txt" command from the library's directory. Note that the code was suitably documented allowing you to make modifications, and to gain full understanding of the algorithm. Preliminary tests show that this library can resize 8-bit RGB 5184x3456 (17.9 Mpixel) image down to 1037x691 (0.7 Mpixel) image in 355 milliseconds, utilizing a single thread, on a typical Intel Core i7-4770K processor-based system without overclocking. This scales down to 110 milliseconds if 4 threads are utilized. This time can be reduced further down to 80 milliseconds by utilizing SIMD floating point type. This library's performance has a big potential to grow together with evolving processor architectures as currently performance is clearly limited by memory bandwidth, not by algorithm's overhead. Multi-threaded operation is not provided by this library "out of the box". The multi-threaded infrastructure is fully available, but requires additional system-specific interfacing code for engagement. ## SIMD Usage Information ## This library is capable of using SIMD floating point types for internal variables. This means that up to 4 color channels can be processed in parallel. For example, this gives 40% performance boost when downsizing 3-channel images. During upsizing the boost is limited to 12%, but is still significant. Since the processing algorithm itself remains non-SIMD, the use of SIMD types is not practical for 1-channel image resizing (due to overhead). SIMD type can be used this way: * # include "avir_float4_sse.h" * avir :: CImageResizer< avir :: fpclass_float4 > ImageResizer( 8 ); ## Notes ## This library was tested for compatibility with [GNU C++](http://gcc.gnu.org/), [Microsoft Visual C++](http://www.microsoft.com/visualstudio/eng/products/visual-studio-express-products) and [Intel C++](http://software.intel.com/en-us/c-compilers) compilers, on 32- and 64-bit Windows, Mac OS X and CentOS Linux. The code was also tested with Dr.Memory/Win32 for the absence of uninitialized or unaddressable memory accesses. All code is fully "inline", without the need to compile any source files. The memory footprint of the library itself is very modest, except that the size of the temporary image buffers depends on the input and output image sizes, and is proportionally large. The "heart" of resizing algorithm's quality resides in the parameters defined via the **avir::CImageResizerParams** structure. While the default set of parameters that offers a good quality was already provided, there is still a place for improvement exists, and the default parameters may change in a future update. If you need to recall an exact set of parameters, simply save them locally for a later use. When the algorithm is run with no resizing applied (k=1), the result of resizing will not be an exact copy of the source image: a very small amount of non-pronounced ringing artifacts, especially around sharp features like screen fonts should be expected. The reason for this is that the image is heavily low-pass filtered at first to reduce aliasing during subsequent resizing, and at last filtered by a correction filter that has a limited length and moderate steepness as to not cause ringing artifacts. This library includes a binary command line tool "imageresize" for major desktop platforms. This tool was designed to be used as a demonstration of library's performance and as a reference, it uses 4 threads and float4 SIMD internal type during processing. This tool uses the following libraries: * turbojpeg Copyright (c) 2009-2013 D. R. Commander * libpng Copyright (c) 1998-2013 Glenn Randers-Pehrson * zlib Copyright (c) 1995-2013 Jean-loup Gailly and Mark Adler ## Interpolation Discussion ## The use of certain low-pass filters and 2X upsampling in this library is hardly debatable, because they are needed to attain a certain anti-aliasing effect and keep ringing artifacts low. But the use of sinc function-based interpolation filter that is 18 taps-long can be questioned, because even in 0th order case such interpolation filter requires 18 multiply-add operations. Comparatively, an optimal Hermit or cubic interpolation spline requires 8 multiply and 11 add operations. One of the reasons 18-tap filter is preferred, is because due to memory bandwidth limitations using a lower-order filter does not provide any significant performance increase (e.g. 14-tap filter is less than 5% more efficient). At the same time, in comparison to cubic spline, 18-tap filter embeds a low-pass filter that rejects signal above 0.5*pi (provides additional anti-aliasing filtering), and this filter has a consistent shape at all fractional positions. Splines have a varying low-pass filter shape at different fractional positions (e.g. no low-pass filtering at 0.0 position, and maximal low-pass filtering at 0.5 position). 18-tap filter also offers a superior stop-band attenuation which almost guarantees absence of artifacts if the image is considerably sharpened afterwards. ## Users ## This library is used by: Please drop me a note at aleksey.vaneev@gmail.com and I will include a link to your software product to the list of users. This list is important at maintaining confidence in this library among the interested parties.