You are on page 1of 4

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. 7, NO.

1, JANUARY 2010 123

Satellite Image Resolution Enhancement Using


Complex Wavelet Transform
Hasan Demirel and Gholamreza Anbarjafari

Abstract—In this letter, a satellite image resolution enhance- form (CWT) [6] is one of the recent wavelet transforms used
ment technique based on interpolation of the high-frequency sub- in image processing. A one-level CWT of an image pro-
band images obtained by dual-tree complex wavelet transform duces two complex-valued low-frequency subband images and
(DT-CWT) is proposed. DT-CWT is used to decompose an input
low-resolution satellite image into different subbands. Then, the six complex-valued high-frequency subband images. The high-
high-frequency subband images and the input image are interpo- frequency subband images are the result of direction-selective
lated, followed by combining all these images to generate a new filters. They show peak magnitude responses in the presence of
high-resolution image by using inverse DT-CWT. The resolution image features oriented at +75◦ , +45◦ , +15◦ , −15◦ , −45◦ , and
enhancement is achieved by using directional selectivity provided −75◦ [7].
by the CWT, where the high-frequency subbands in six different
directions contribute to the sharpness of the high-frequency details In this letter, we propose a new technique which generates
such as edges. The quantitative peak signal-to-noise ratio (PSNR) sharper and detailed superresolved satellite images. The pro-
and visual results show the superiority of the proposed tech- posed technique uses dual-tree CWT (DT-CWT) to decompose
nique over the conventional bicubic interpolation, wavelet zero a low-resolution image into different subband images. Then
padding, and Irani and Peleg based image resolution enhancement the six complex-valued high-frequency subband images are
techniques.
interpolated using bicubic interpolation. In parallel, the input
Index Terms—Dual-tree complex wavelet transform (DT-CWT), image is also interpolated separately. Finally, the interpolated
resolution enhancement, satellite images. high-frequency subband images and interpolated input image
are combined by using inverse DT-CWT (IDT-CWT) to achieve
I. I NTRODUCTION a high-resolution output image. The proposed technique has
been compared with conventional and state-of-the-art image

N OWADAYS, satellite images are used in many appli-


cations such as geoscience studies, astronomy, and ge-
ographical information systems. One of the most important
resolution enhancement techniques. These techniques are the
following:

quality factors in images comes from its resolution. Interpo- 1) interpolation techniques, namely, nearest interpolation,
lation in image processing is a well-known method to increase bilinear interpolation, and bicubic interpolation;
the resolution of a digital image. Interpolation has been widely 2) wavelet zero padding (WZP);
used in many image-processing applications such as facial re- 3) single-frame resolution enhancement by Irani and Peleg
construction [1], multiple-description coding [2], and resolution [8], where four low-resolution images generated by rota-
enhancement [3], [4]. tion and translation from the input low-resolution image
Many interpolation techniques have been developed to in- are used.
crease the image resolution. There are three well-known in- According to the results, the proposed technique outper-
terpolation techniques, namely, nearest neighbor interpolation, forms the aforementioned state-of-the-art and conventional
bilinear interpolation, and bicubic interpolation. Bicubic inter- techniques for image resolution enhancement.
polation is more sophisticated than the other two techniques;
however, it produces noticeably sharper images.
Image-resolution enhancement in the wavelet domain is a II. P ROPOSED DT-CWT-BASED S ATELLITE I MAGE
relatively new research topic, and, recently, many new algo- R ESOLUTION E NHANCEMENT
rithms have been proposed [4], [5]. Complex wavelet trans-
Resolution is an important feature in satellite imaging, which
makes the resolution enhancement of such images to be of
Manuscript received June 5, 2009; revised July 9, 2009 and July 13, vital importance. As it was mentioned before, there are many
2009. First published September 11, 2009; current version published
January 13, 2010. applications of using satellite images, hence, resolution en-
H. Demirel is with the Department of Electrical and Electronic Engineer- hancement of such images will increase the quality of the
ing, Eastern Mediterranean University, Famagusta, North Cyprus, Mersin 10, other applications. The main loss of an image after being
Turkey (e-mail: hasan.demirel@emu.edu.tr).
G. Anbarjafari is with the Department of Electrical and Electronic superresolved by applying interpolation is on its high-frequency
Engineering, Eastern Mediterranean University, Famagusta, North Cyprus, components (i.e., edges), which is due to the smoothing caused
Mersin 10, Turkey, and also with the Faculty of Engineering, Cyprus In- by interpolation. Hence, in order to increase the quality of the
ternational University, Nicosia, North Cyprus, Mersin 10, Turkey (e-mail:
shahab.jafari@emu.edu.tr). superresolved image, preserving the edges is essential. In this
Digital Object Identifier 10.1109/LGRS.2009.2028440 letter, DT-CWT has been employed in order to preserve the
1545-598X/$26.00 © 2009 IEEE

Authorized licensed use limited to: GOVERNMENT COLLEGE OF TECHNOLOGY. Downloaded on June 30,2010 at 08:44:11 UTC from IEEE Xplore. Restrictions apply.
124 IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. 7, NO. 1, JANUARY 2010

Fig. 1. Block diagram of the proposed resolution enhancement algorithm.

high-frequency components of the image. The DT-CWT has CWT of the interpolated subband images and the input image.
good directional selectivity and has the advantage over discrete In the proposed technique, the employed interpolation method
wavelet transform (DWT). It also has limited redundancy [6]. is the same for all subband and the input images. The visual
The DT-CWT is approximately shift invariant, unlike the crit- and the peak signal-to-noise ratio (PSNR) results, in the next
ically sampled DWT. The redundancy and shift invariance of section, show that the proposed technique with bicubic interpo-
the DT-CWT mean that DT-CWT coefficients are inherently lation outperforms the conventional bicubic interpolation, WZP,
interpolable [7]. and Irani and Peleg techniques.
In the proposed image resolution enhancement technique,
DT-CWT is used to decompose an input image into different
III. R ESULTS AND D ISCUSSIONS
subband images. Six complex-valued high-frequency subband
images contain the high-frequency components of the input Fig. 2 shows that superresolved images using the
image. In the proposed technique, the interpolation is applied proposed technique in (c) are much sharper than the original
to the high-frequency subband images. In the wavelet domain, low-resolution images in (a) and the interpolated images in (b).
the low-resolution image is obtained by lowpass filtering of In order to show the effectiveness of the proposed
the high-resolution image [9]. In other words, low-frequency method over the conventional and state-of-the-art image res-
subband images are the low resolution of the original image. olution enhancement techniques, five satellite images with
Therefore, instead of using low-frequency subband images, different features are used for comparison. Tables I and II
which contain less information than the original input image, compare the PSNR performance of the proposed technique
we are using the input image for the interpolation of two with the conventional bicubic interpolation, WZP, and Irani
low-frequency subband images. Hence, using the input image and Peleg [8] techniques with factors of two and four,
instead of the low-frequency subband images increases the respectively.
quality of the superresolved image. Note that the input image The visual results of the proposed technique shown in Fig. 2
is interpolated with the half of the interpolation factor α used to support the quantitative results in Tables I and II. For example,
interpolate the high-frequency subbands, as illustrated in Fig. 1. in Fig. 2-(1) image, the PSNR of proposed technique is 2.16 and
The two upscaled images are generated by interpolating the 6.74 dB higher than the PSNR obtained by using the bicubic
low-resolution original input image and the shifted version of interpolation and WZP technique, respectively. Results in both
the input image in horizontal and vertical directions. These two tables indicate the superiority of the proposed technique over
real-valued images are used as the real and imaginary compo- the conventional and state-of-the-art image resolution enhance-
nents of the interpolated complex LL image, respectively, for ment techniques.
the IDT-CWT operation. By interpolating the input image by
α/2 and the high-frequency subband images by α and then
IV. C ONCLUSION
by applying IDT-CWT, the output image will contain sharper
edges than the interpolated image obtained by interpolation of This letter proposes a satellite image resolution enhancement
the input image directly. technique based on the interpolation of the high-frequency
This is due to the fact that the interpolation of the isolated subband images obtained by DT-CWT and the input image. The
high-frequency components in the high-frequency subband proposed technique uses DT-CWT to decompose an image into
images will preserve more high-frequency components after different subband images, and then the high-frequency subband
the interpolation of the respective subbands separately than images are interpolated. An original image is interpolated with
interpolating the input image directly. half of the interpolation factor used for interpolation of the
In summary, the proposed technique interpolates not high-frequency subband images. Afterward, all these images
only the input image but also the high-frequency subband are combined using IDT-CWT to generate a superresolved
images obtained through the DT-CWT process. The final image. The proposed technique has been tested on several
high-resolution output image is generated by using the IDT- satellite images, where their PSNR and visual results show the

Authorized licensed use limited to: GOVERNMENT COLLEGE OF TECHNOLOGY. Downloaded on June 30,2010 at 08:44:11 UTC from IEEE Xplore. Restrictions apply.
DEMIREL AND ANBARJAFARI: SATELLITE IMAGE RESOLUTION ENHANCEMENT 125

Fig. 2. (a) Original low-resolution image. (b) Bicubic interpolated image. (c) Superresolved image using the proposed technique.

superiority of the proposed technique over the conventional and to the directional selectivity of the CWT, where the high-
state-of-the-art image resolution enhancement techniques. The frequency subbands in six different directions contribute to the
main reason of the resolution enhancement can be attributed sharpness of the high-frequency details such as edges.

Authorized licensed use limited to: GOVERNMENT COLLEGE OF TECHNOLOGY. Downloaded on June 30,2010 at 08:44:11 UTC from IEEE Xplore. Restrictions apply.
126 IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. 7, NO. 1, JANUARY 2010

TABLE I in MATLAB and the Google Earth and Satellite Imaging


PSNR (dB) R ESULTS FOR THE P ROPOSED R ESOLUTION E NHANCEMENT
W ITH A FACTOR OF T WO , F ROM 256 × 256 TO 512 × 512, FOR THE Corporation for providing satellite images for research
I NPUT I MAGES S HOWN IN F IG . 2(a) C OMPARED W ITH THE purposes.
C ONVENTIONAL AND S TATE - OF - THE -A RT I MAGE R ESOLUTION
E NHANCEMENT T ECHNIQUES
R EFERENCES
[1] Y.-B. Li, H. Xiao, and S.-Y. Zhang, “The wrinkle generation method
for facial reconstruction based on extraction of partition wrinkle line
features and fractal interpolation,” in Proc. 4th ICIG, Aug. 22–24, 2007,
pp. 933–937.
[2] Y. Rener, J. Wei, and C. Ken, “Downsample-based multiple description
coding and post-processing of decoding,” in Proc. 27th CCC, Jul. 16–18,
2008, pp. 253–256.
[3] C. B. Atkins, C. A. Bouman, and J. P. Allebach, “Optimal image
scaling using pixel classification,” in Proc. ICIP, Oct. 7–10, 2001, vol. 3,
TABLE II pp. 864–867.
PSNR (dB) R ESULTS FOR THE P ROPOSED R ESOLUTION E NHANCEMENT [4] Y. Piao, I. Shin, and H. W. Park, “Image resolution enhancement using
W ITH A FACTOR OF F OUR , F ROM 128 × 128 TO 512 × 512, FOR THE inter-subband correlation in wavelet domain,” in Proc. ICIP, 2007, vol. 1,
I NPUT I MAGES S HOWN IN F IG . 2(a) C OMPARED W ITH THE pp. I-445–I-448.
C ONVENTIONAL AND S TATE - OF - THE -A RT I MAGE R ESOLUTION [5] W. K. Carey, D. B. Chuang, and S. S. Hemami, “Regularity-preserving
E NHANCEMENT T ECHNIQUES image interpolation,” IEEE Trans. Image Process., vol. 8, no. 9, pp. 1295–
1297, Sep. 1999.
[6] N. G. Kingsbury, “Image processing with complex wavelets,” Philos.
Trans. R. Soc. London A, Math. Phys. Sci., vol. 357, no. 1760, pp. 2543–
2560, Sep. 1999.
[7] T. H. Reeves and N. G. Kingsbury, “Prediction of coefficients from coarse
to fine scales in the complex wavelet transform,” in Proc. IEEE ICASSP,
Jun. 5–9, 2000, vol. 1, pp. 508–511.
[8] M. Irani and S. Peleg, “Improving resolution by image registration,”
CVGIP: Graph. Models Image Process., vol. 53, no. 3, pp. 231–239,
May 1991.
[9] A. Temizel, “Image resolution enhancement using wavelet domain hidden
ACKNOWLEDGMENT Markov tree and coefficient sign estimation,” in Proc. ICIP, 2007, vol. 5,
pp. V-381–V-384.
The authors would like to thank Prof. I. Selesnick from
Polytechnic University for providing the DT-CWT codes

Authorized licensed use limited to: GOVERNMENT COLLEGE OF TECHNOLOGY. Downloaded on June 30,2010 at 08:44:11 UTC from IEEE Xplore. Restrictions apply.

You might also like