Nowadays, mobile phones are more than a device that can only satisfy the communication need between people. In addition to providing ease to human lives with various applications, lens kits that can be integrated to mobile phones have recently been introduced. Fisheye lenses that are compliant with mobile phones are one of these new types of equipment. Since fisheye lenses integrated with mobile phones are lightweight and easy to use, they are advantageous. In addition to this advantage, whether fisheye lens and mobile phone combination can be used in a photogrammetric way is experimented, and if so, what will be the result. The main purpose of this study is to test fisheye lens equipment used with mobile phones. In this study, standard calibration of “Olloclip 3 in one” fisheye lens used with iPhone 4S mobile phone and “Nikon FC-E9” fisheye lens used with Nikon Coolpix8700 are compared based on equidistant model. The results of these calibrations are analyzed, using photogrammetric bundle block adjustment. This study suggests a precalibration process of these kinds of hardware for the photogrammetric process in the test field.
1. Introduction
While mobile phones are mainly used for outdoors communication, the developing electronics technology enabled them to be used for various other applications on the Globe as well. Classical lens kit is one of the samples that have long been mounted to mobile phones giving people the opportunity to take pictures and share transiently. Recently, state-of-the-art technology product fisheye lenses which have been integrated with mobile phones are one of these new types of equipment. These types of equipment are lightweight and easy to use. Additionally, these lenses are cost efficient compared to conventional fisheye lenses. Some of those lens kits for iPhone are presented in [1]. The characteristics of Olloclip lens used in this paper are presented in [2]. Cameras on mobile phones are as capable as compact cameras that we use in our daily lives. Today, people do not want to possess a digital camera since mobile phones are equipped with enough capable cameras. There are studies which examine whether mobile phone cameras can be used in photogrammetric studies. Reference [3] reports first experiences in calibration and accuracy validation of mobile phone cameras. In [4], building facades are captured with mobile phone cameras and digital cameras and the obtained images are converted into vertical plane with Pictran, PhotoModeler, and PhoTopol photogrammetric software. Reference [5] confirmed the advantages of the proposed system by evaluation experiments. The new system will be able to contribute to the novel mobile Web map services with fisheye views for mobile terminals such as cellular phones.
Fisheye lenses provide instant wide angle images from one point with a single camera. Fisheye optics are placed onto CCD (Charge Couple Device) or CMOS (Complementary Metal Oxide Semiconductor) cameras without needing any complex technology. They do not require an external mirror or rotational device. Thus, these optics are small in size and do not require any maintenance [6]. They have a very short focal length, which produces a hemisphere [7]. Fisheye lenses allow imaging a large sector of the surrounding space by a single photo; therefore, they are useful for several applications. Besides the pure visualization of landscapes or interiors (e.g., ceiling frescos in historical buildings) for advertisement or internet presentations, fisheye images can also be used for measurement tasks [8]. The first fisheye lens has been created by R. Hill in 1924 [9], but they have not been preferred in photogrammetric measurements since they provide images with huge distortions and they do not meet central projection. Using the images obtained from fisheye lens imaging systems in photogrammetric measurement and modeling processes becomes popular in recent years by the help of the development in software and hardware technologies. Lately, a significant increase has been seen in terms of volume scientific research on this subject matter. Recently, there have been several academic studies presenting the benefit from fisheye lenses. Fisheye cameras are finding increasing number of applications in surveillance, robotic vision, automotive rear-view imaging systems, and so forth, because of their wide angle properties [10]. Fisheye lens cameras have also been used during sky observations [11], visual sun compass creation [12], and sun path diagram derivation [13]. A novel panoramic imaging system uses a curved mirror as a simple optical attachment to a fisheye lens [14]. Reference [15] describes a visual markerless real-time tracking system for Augmented Reality applications. The system uses a FireWire camera with a fisheye lens mounted at 10 fps. Reference [16] presents a new Mobile Mapping System mounted on a vehicle to reconstruct outdoor environment in real time. Reference [17] presents a cooperative approach for tracking a moving spherical object in three-dimensional space by a team of mobile robots equipped with sensors, in a highly dynamic environment. Reference [18] explores the use of a fisheye camera to achieve the scene tunnel acquisition. In [19] the authors have focused on dioptric systems to implement a robot surveillance application for fast and robust tracking of moving objects in dynamic, unknown environments. Another application that uses fisheye lens is a research which examines the use of fisheye lenses as optical sensors on Unmanned Aerial Vehicle (UAV) platform in Queensland Technical University in Australia [20]. Reference [21] uses a fisheye camera for horizon detection in aerial images. Reference [22] proposes three-dimensional measurement method of underwater objects using a fisheye stereo camera. In [23], a novel technique to accurately estimate the global position of a moving car using an omnidirectional camera and untextured three-dimensional city model is proposed. Today, one of the areas that most frequently benefit from fisheye lenses are applications done in combination with terrestrial laser scanners. Reference [24] presents a comparison of automatic photogrammetric techniques to terrestrial laser scanning for three-dimensional modeling of complex interior spaces. The 8 mm fisheye lens that was used allowed us to acquire photos with a global view of the scene and thus with textured zones in every image, which is essential for the Scale Invariant Feature Transform (SIFT) algorithm. Reference [25] presents the integration of a geometric model of fisheye lenses and a geometric terrestrial laser scanner model in a bundle block adjustment.
Fisheye projection functions are designed such that a greater portion of the scene is projected onto the image sensor on the image plane, at the expense of introducing (often considerable) radial distortion [26]. The fisheye lens camera should be calibrated to be used in applications that require high accuracy [27]. There are different studies in literature which focus on the calibration of fisheye lenses. Reference [6] presented rigorous mathematical models for the calibration of a stereo system composed of two fisheye lens cameras and for the epipolar rectification of the images acquired by this dual system. Reference [28] presented the calibration of a Kodak DSC 14 Pro with Nikkor 8 mm fisheye lens, which follows the equidistant projection. The rigorous mathematical models based on stereographic, equidistant, orthogonal, and equisolid angle projections were used in combination with symmetric radial, decentering, and affinity distortion models. Reference [29] proposes a generic camera model, which is suitable for fisheye lens cameras as well as for conventional and wide angle lens cameras, and a calibration method for estimating the parameters of the model. Fisheye lenses are not perspective lenses, image resolution in these lenses is not fixed (univocal), and illumination is not distributed homogeneously [30]. In photogrammetry, the collinearity mathematical model, based on perspective projection combined with lens distortion models, is generally used in the camera calibration process. However, fisheye lenses are designed for the following different spherical projections models such as stereographic, equidistant, orthogonal, and equisolid angle [27]. The technical construction of most fisheye lenses complies with the equidistant or equisolid angle projection. Diagonal fisheye lenses are mainly constructed following the equisolid angle projection geometry, where the distortion in the image edges is more significant in comparison to fisheye lenses with the equidistant projection. The orthographic projection geometry can only be realized with a sophisticated optical construction. Stereographic projection is not practically realizable [28]. Among the other models proposed, an important one is the equidistant model. The model proposes that the distance between an image point and the center of radial distortion is proportional to the angle between a corresponding three-dimensional point, the optical center, and the optical axis [31]. Equidistant fisheye lenses are often used for scientific measurement where the measurement of angles is necessary. Thus, it is also sometimes referred to as an equiangular fisheye lens [32].
The main purpose of this study is to test fisheye lens equipment used with mobile phones. Mobile phone imaging with the additional hardware has been used more popularly not only outside but also indoor applications. Therefore, hardware properties of this wide angle optics will be used in the photogrammetric documentation in the near future for mobile phone imaging. Since fisheye lenses integrated with mobile phones are lightweight and easy to use, they are advantageous. In addition to this advantage, it is experimented whether fisheye lens and mobile phone combination can be used in a photogrammetric way, and if so, what will be the result. In this study, standard calibration of “Olloclip 3 in one” fisheye lens used with iPhone 4S mobile phone and “Nikon FC-E9” fisheye lens used with Nikon Coolpix8700 are compared based on equidistant model. The results of these calibrations are analyzed, using photogrammetric bundle block adjustment. Geometric properties of this wide angle lenses will be more important in the photogrammetric measurement assessment. This study suggests a precalibration process of these kinds of hardware for the photogrammetric process in the test field. In the literature, although there are many geometric camera calibration publications, none of them compares the mobile phone fisheye lens kit with conventional fisheye lens on the fundamentals of photogrammetric measurement assessment. The results of this photogrammetric process are also compared with conventional wide angle hardware in this paper.
Section 2 of this paper briefly describes equidistant model. Section 3 reports an empirical study for calibration of the combination of iPhone 4S camera with Olloclip 3 in one fisheye lens and Nikon Coolpix8700 camera FC-09 fisheye lens combination by using equidistant model. Section 4 interprets the results which are outcome from the experiment process. In Section 5, the advantages and disadvantages have been explained according to the obtained results for iPhone 4S camera with Olloclip 3 in one fisheye lens.
2. Equidistant Projection Function for Fisheye Lenses
The perfect fisheye lens can be modeled as a sphere through which scene projections are described by two basic properties. First, the field of view encompasses 2π steradians and produces a circular image so that distortions are symmetrical about the image center. Second, the fisheye lens possesses an infinite depth-of-field in that all objects in the image are in focus. Furthermore, the formation of nonlinear image distortion is governed by two postulates, the azimuth angle invariability and the equidistant projection rule. These postulates describe the projection of object points onto the sensor and will directly affect the dewarping algorithm that will be subsequently developed [33].
The first postulate is that the azimuth angle invariability governs the projection of points lying in the plane that passes through the optical axis perpendicular to the sensor plane. The azimuth angle of the object points and their projections onto the sensor remain unchanged due to differences in the object distance or elevation within the content plane [33]. According to [34], the equidistant lens is “preferable for measurement of incidence angles (θ) and azimuth angles. The effect of error of lens position is small, and the linear relation of radial distance (rd) and incidence angle (θ) of a ray from the three-dimensional point is convenient to analyze”.
The equidistant projection rule, the second postulate, describes the relationship between the radial distance (rd) of an image point in the sensor plane to the zenith (incidence, (θ)) angle created by the vector from the image center to the world object point as defined in Figure 1. This rule states that for a spherical lens a linear relationship exists between the center to image point radial distance, rd, and the zenith angle, (θ) [33].
As the zenith angle varies from 0 to 90 degrees, the radial distance of the corresponding image point varies linearly from 0 to a maximum value R, determined by the modeled sphere’s radius [33].
In equidistant projection, the radial distance (rd) on the image plane is directly proportional to the angle of the incident ray and is equivalent to the length of the arc segment between the z-axis and the projection ray of point P on the sphere Figure 2 [26].
Equidistant fisheye projection function representation.
Thus, the equidistant projection function is given as follows:(1)rd=f·θ,where rd is the fisheye radial distance of a projected point from the center, f is focal distance, and θ is the incidence angle of a ray from the three-dimensional point being projected to the image plane. This is one of the more common mapping functions that fisheye cameras are designed to follow, the others being the stereographic, equisolid, and orthogonal mapping functions [36]. Equation (2) is derived by substituting arctangent function for θ in (1), where ru is the height of the projection on the image plane (the subscript u being used to denote the undistorted projection) [32]:(2)rd=f·arctanruf.
In equidistant projection model, the angle of the projected ray in radians translates linearly to the distorted radial distance on the image plane. Additionally, the projected distorted distance rd is equivalent to the length of the arc segment between the z-axis and XP, which is the point of intersection of the projection ray of point X with the projection sphere [32].
Most real optical systems have some undesirable effects, rendering the assumption of the pinhole camera model inaccurate. The significant evident of these effects is radial barrel distortion, particularly noticeable in fisheye camera systems, where the level of this distortion is relatively extreme [26]. For normal and narrow field of view (FOV) cameras, the effects of radial distortion can be considered negligible for most application. However, in wide angle and fisheye cameras, radial distortion can cause severe problems, not only visually but for further processing in computer vision applications such as object detection, recognition, and classification [32]. Radial lens distortion causes points on the image plane to be displaced in a nonlinear fashion from their ideal position in the rectilinear pinhole camera model, along a radial axis from the distortion center in the equidistant image plane. The visual effect of this displacement in fisheye optics is that the image will have a higher resolution in the foveal areas, with the resolution decreasing nonlinearly towards the peripheral areas of the image [37].
For additional parameters to compensate for deviations of the geometric fisheye model from the physical reality, the same parameters are applied as they are in common use for central perspective lenses [28]. Accordingly the equidistant projection function with additional parameters is given as follows:(3)rd=f·arctanruf+Additional Parameters.
Due to the particularly high levels of distortion present in fisheye cameras, there have been several alternative models developed [37]. Some models are Fisheye Transform, field of view, Division Model, and Polynomial Model [38]. The work in [28] investigates the addition of the Brown parameters to the basic geometric fisheye model to compensate for the remaining “systematic effects” [38].
To describe the projection of an object point into a hemispherical fisheye lens image, three coordinate system are used. The superordinated cartesian object coordinate system (X, Y, Z) and the camera coordinate system (x, y, z) in Figure 3. The image coordinate system (x′, y′) is defined as usual in photogrammetric applications, which means the origin is the image center, and the x′-axis and y′-axis are parallel with the x-axis and y-axis of camera coordinate system [28]. The geometric concept is based on the dependence of the image radius r′ and the angle of incidence θ [25].
Geometrical model of a fisheye camera.
Object coordinates are transformed into the camera coordinate system. One has (4), where X is the coordinate vector in the object coordinate system; x is the coordinate vector in the camera coordinate system; R is the rotation matrix and X0 the translation between object and camera coordinate system: (4)x=R-1X-X0.
The incidence angle θ in the camera coordinate system is defined as follows: (5)tanθ=x2+y2z.
Instead of functions for the image radius r′, functions for the image coordinates x′ and y′ are required. For this purpose (6) is applied: (6)r′=x′2+y′2.
After transformations of the equations are described above, the final fisheye projection equations for the image coordinates are derived.
The model equations are finally extended by the coordinates of the principal point x0′ and y0′ (see (7)) and the correction terms Δx′ and Δy′ (see (8) and (9)) which contain additional parameters to compensate for systematic effects.
Equidistant projection: (7)x′=c·arctanx2+y2/zy/x2+1+x0′+Δx′,y′=c·arctanx2+y2/zx/y2+1+y0′+Δy′,(8)Δx=x′·A1r′2+A2r′4+A3r′6+B1·r′2+2x′2+2B2x′y′+C1·x′+C2·y′,(9)Δy=y′·A1r′2+A2r′4+A3r′6+2B1x′y′+B2·r′2+2y′2,where; A1, A2, and A3 are radial distortion parameters. B1 and B2 are decentric distortion parameters. C1 and C2 are horizontal scale factor and shear factor. c is the camera constant which equals focal distance.
3. Experiments
The characteristics of the cameras and fisheye lenses which were chosen for the application are given below.
Nikon Coolpix8700 digital camera has 8-megapixel resolution and CCD sensor. The 8x optical Zoom-Nikkor lens (f/2.8–4.2) offers a focal range of 8.9–71.2 mm [39]. Nikon FC-E9 fisheye lens: focal length of the camera’s lens reduced to x0.2 provides approximately 183° (COOLPIX 5700)/190° (COOLPIX 5400) view angle [39].
iPhone 4S camera has 8-megapixel resolution and CMOS sensor. Its focal length is 35 mm [40]. Olloclip 3 in one fisheye lens: the Olloclip is a device providing three different lens options for iPhone; these are wide-angle, fisheye, and macro. The Olloclip with the fisheye lens acquires 180-degree field of view [41].
Application’s camera fisheye lens combinations are shown in Figure 4 and also Table 1 shows technical specifications of the cameras used in the application.
Technical specifications of the cameras.
iPhone 4S
Nikon Coolpix8700
Sensor
CMOS 1/3.2′′ sensor size
CCD 2/3′′
Image resolution
3264 × 2448 (8.0 MP)
3264 × 2448 (8.0 MP)
∗Focal length
4.324602 mm
9.027620 mm
∗Pixel size
1.4 µm
2.7 µm
Digital zoom values
Up to 5x
Up to 4x
Aspect ratio
4 : 3
4 : 3; 3 : 2
LCD size
3.5′′
1.8′′
∗These are the values obtained after separate calibrations performed before the application in PI3000 software for iPhone 4S and Nikon Coolpix8700 cameras used in the application. The pictures in the resolution of 3264 × 2448 are taken in this focal length.
Camera fisheye equipment used in application ((a) is iPhone 4S with Olloclip 3 in one; (b) is Nikon Coolpix8700 with FC-09 fisheye lenses).
The Olloclip 3 in one was mounted on the iPhone 4S. Images acquired with iPhone 4S and Olloclip 3 in one fisheye lens combination were captured with a focal distance of 4.28 mm. Images have 3264 × 2448 pixels and 1.4 μm pixel width.
The calibration field used in this study is a satellite antenna having 150 cm diameter with 112 control points on it. It was chosen since it has a smooth digital surface model and it is geometrically similar to the lens surface model. In this way, the analysis of the errors caused by the geometry of the objective and a balanced distribution of the depth differences over the image acquisition line on the surface model are accomplished. Point location accuracy is approximately 30–35 μm. In order to get the determined point location accuracy, a geodesic Wild T3 theodolite was chosen for direction measurements. In total, five serial measurements were made horizontally and vertically with Wild T3 [42]. Used calibration field is complying with self-calibration model which is a dish antenna model. Figure 5 shows the images of the calibration field taken by the two camera-lens combinations. The images of the calibration field were taken with the minimum focal length of each camera without zooming.
Image of calibration field ((a) iPhone 4S camera with Olloclip 3 in one; (b) Nikon Coolpix8700 camera with Nikon FC-E9 fisheye lens).
The application benefits from the comparison made over iPhone 4S Olloclip 3 in one camera fisheye lens combination with Coolpix8700 camera FC-09 fisheye lens combination in terms of equidistant fisheye model (see (7)) which gives the best result in bundle block adjustment. In the application, the calibration values derived from equidistant fisheye model for iPhone 4S Olloclip 3 in one camera fisheye lens combination and Coolpix8700 camera FC-09 fisheye lens combination are compared. (See (8) and (9).) Equations use A1, A2, A3, B1, B2, C1, and C2 coefficients as calibration parameters. Nine of 112 control points are considered passing points, while 103 of them are full control points. 13 images of calibration field were taken by iPhone 4S Olloclip 3 in one camera fisheye lens combination from different locations taking into consideration free network adjustment rules. The same procedure was also applied for Coolpix8700 camera FC-09 fisheye lens combination. After then, the two-dimensional image coordinates of 112 control points for 13 images were measured in Pictran D software for iPhone 4S Olloclip 3 in one camera fisheye lens combination. The same procedure was also applied for Coolpix8700 camera FC-09 fisheye lens combination. The measurements of the two-dimensional image coordinates in Pictran D software are shown in Figure 6.
Measurement of image coordinates of the fisheye lenses in Pictran D software ((a) taken from the combination of iPhone 4S camera with Olloclip 3 in one; (b) taken from the combination of Nikon Coolpix8700 camera with Nikon FC-E9 fisheye lens).
The resulting image coordinates were evaluated in bundle block adjustment software developed by Dr. Danilo Schneider in Dresden Technical University in Germany. According to the bundle block adjustment results, Tables 2 and 3 were acquired.
Calibration results of two different fisheye lenses in bundle adjustment software.
iPhone 4S with Olloclip 3 in one
Nikon Coolpix8700 with Nikon FC-E9
Sigma0
0.00099
0.00163
Convergence
0
0
Maximum iteration
100
100
Required iteration
18
32
Calculation time
3.57 sn
6.41 sn
Unknown
396
396
Observations
2868
2838
Calibration parameters calculated for equidistant model.
iPhone 4S with Olloclip 3 in one (mm)
Nikon Coolpix8700 with Nikon FC-E9 (mm)
Value
Root mean square
Significance
Value
Root mean square
Significance
ck
−2.23950000
0.00161000
8
−1.69005000
0.00203000
8
x0
0.05886000
0.00397000
8
0.03987000
0.00259000
8
y0
0.10471000
0.00399000
8
0.11442000
0.00240000
8
A1
0.00080228
0.00027401
8
0.00118750
0.00038919
6
A2
−0.00386240
0.00007329
8
−0.00067814
0.00005062
8
B1
−0.00105490
0.00016903
8
−0.00026227
0.00012548
4
B2
−0.00137450
0.00015347
8
0.00021274
0.00011927
3
C1
0.00050562
0.00032783
1
−0.00009505
0.00029182
1
C2
−0.00038251
0.00030980
6
0.00031644
0.00028458
1
The results of bundle block adjustment calculation by the software for 13 images captured with iPhone 4S camera and Olloclip 3 in one are given, respectively; the sigma0 value is 0.00099 and the pixel size is 0.0022 mm. The results of bundle block adjustment calculations by the software for 13 images captured with Nikon Coolpix8700 camera and FC-09 fisheye lens are given, respectively; the sigma0 value is 0.00163 and the pixel size is 0.0022 mm. Sigma0 is the root mean square of measurements for image coordinates after bundle block adjustment. Table 2 shows the resulting values in both of the calibrations. According to software’s postadjustment outputs, additionally, projection point parameters (X0, Y0, Z0 and omega, phi, kappa) of the 13 images and object points’ significance for both the camera and lens combination are 8, which is 99.9 percent. (Software’ significance values are 1—no significance, 2—80%, 3—90%, 4—95%, 5—98%, 6—99%, 7—99.8%, and 8—99.9% high significance.)
Figure 7 shows actual positions of three-dimensional coordinates of calibration field obtained by adjustment results and projection points of each of the 13 images that come from both of the calibration files acquired after adjustment.
Three-dimensional position of projection points with regard to antenna; three-dimensional coordinates of the camera as the result of balancing ((a) shows values for iPhone 4S camera with Olloclip 3 in one and (b) shows values for Nikon Coolpix8700 camera with Nikon FC-E9 fisheye lens).
4. Results
At the end of the application designed for testing, numerical values of calibration parameters and root mean square of those parameters that were calculated according to equidistant model were compared between the “Olloclip 3 in one” fisheye lens used with iPhone 4S mobile phone and standard “Nikon FC-E9” fisheye lens used in Nikon Coolpix8700. This comparison is given in Table 3 and the resulting graphics are shown in Figures 8 and 9.
Distortion parameters for two different camera fisheye lens combinations.
Root mean square values of distortion parameters for two different camera fisheye lens combinations.
Since A3 distorsion parameter was a so small value that can be ignored, it was not analyzed and written in Table 3. Table 3 shows that the significance values of the iPhone are higher than that of Nikon because of smaller pixel (they are given in Table 1) structure of iPhone’s camera.
When Figure 8 is examined, it is seen that distortion parameters of iPhone 4S camera and Olloclip 3 in one fisheye lens equipment are larger, although they have a larger focal length. It does not show a significant difference compared to Nikon Coolpix8700 camera and FC-09 fisheye lens equipment. (ck: focal length after calibration process, x0: image coordinate of principle point in X direction, and y0: image coordinate of principle point in Y direction).
Figures 8 and 9 illustrate that when x0, y0 principal image point coordinate values and focal lengths of two different fisheye lens are ignored for the cameras with the same resolution and the same pixel size, a meaningful approximation is obtained. In consideration of these results, current technology developed for Olloclip 3 in one lens that is improved for mobile phones is particularly great. Nikon FC-E9 mounted on bulky Nikon Coolpix8700 is difficult to use. Olloclip 3 in one lens mounted on iPhone 4S is considered to be used in studies done with photogrammetric fisheye lens instead of Nikon FC-E9. The conclusion part compares the advantages and disadvantages of two different fisheye images.
Nine of 112 control points are considered as passing points, while 103 of them are full control points. 103 point coordinates from testing area are considered errorless and used in bundle block adjustment. Three-dimensional position data derived from the bundle block adjustment are compared to the errorless points. Nikon Coolpix8700 camera and FC-09 fisheye lens combination gives accuracy on 85 points under the subpixel level. iPhone 4S camera and Olloclip 3 in one fisheye lens combination gives accuracy on 89 points under the subpixel level. This means that there is 82.52% accuracy for Nikon Coolpix8700 camera and FC-09 fisheye lens combination and 86.40% accuracy for iPhone 4S camera and Olloclip 3 in one fisheye lens combination.
The coordinates of three-dimensional object coordinates of 103 points are subtracted from the points which derived from bundle block adjustment process. If the difference values are greater than subpixel level in any axis then they are eliminated; consequently Figures 10 and 11 are depicted from the obtained differences, respectively, for iPhone 4S camera and Olloclip 3 in one fisheye lens combination and Nikon Coolpix8700 camera and FC-09 fisheye lens combination. Delta X is the difference between three-dimensional point coordinate which is measured before adjustment in X direction and three-dimensional point coordinate which is derived after adjustment in X direction. Delta Y and delta Z were calculated similarly.
Subpixel graphic for the combination of iPhone 4S camera with Olloclip 3 in one fisheye lens.
Subpixel graphic for the combination of Nikon Coolpix8700 camera with Nikon FC-E9 fisheye lens.
The standard deviations of coordinate differences have been calculated for three different axes from the data contributing to depicting Figures 10 and 11. The standard deviation values on the X, Y, and Z axes are 0.763 mm, 0.558 mm, and 0.638 mm, respectively, for Olloclip 3 in one lens kit. By using similar derivation, the standard deviation values on the X, Y, and Z axes are 0.748 mm, 0.699 mm, and 0.517 mm, respectively, for Nikon FC-09 lens kit. As presented, the standard deviation values of identical axes are found approximately close to each other from the calculations. Moreover, when the distribution of the coordinate differences was evaluated for three identical axes (X, Y, Z) of these two kinds of lens kits, it was calculated that they have the same maximum difference value which is approximately 2 mm. From these graphics, root mean square error of point positions has been determined as 3.556 mm for Olloclip 3 in one and 3.401 mm for Nikon FC-09 lens kit. These values show that the internal reliability of these two kinds of fisheye lens kits are similar for three-dimensional point coordinate determination.
Advantages and disadvantages of using fisheye lenses for the abovementioned equipment can be listed as follows.
Advantages
iPhone 4S camera and Olloclip 3 in one fisheye lens equipment is lightweight and is much more easy to use.
As given in Table 3, focal distance of iPhone 4S camera and Olloclip 3 in one fisheye lens equipment is larger than focal distance of Nikon Coolpix8700 camera and FC-09 fisheye lens equipment. Root mean square of the larger focal distance is smaller than the other one.
There is no significant difference between the image center point coordinates of iPhone 4S camera and Olloclip 3 in one fisheye lens equipment and Nikon Coolpix8700 camera and FC-09 fisheye lens.
Disadvantages
Nikon Coolpix8700 camera and FC-09 fisheye lens equipment is heavier and much more difficult to use.
Since focal distance of iPhone 4S camera and Olloclip 3 in one fisheye equipment is larger than Nikon Coolpix8700 camera and FC-09 fisheye lens equipment, the resulting distortion parameters are expected to be smaller and when distortion parameters of both equipment are compared to each other, there happens to be a stable result that exceeds the expectations.
As given in Table 3, mean square error values for image central point of iPhone 4S camera and Olloclip 3 in one fisheye lens equipment are higher than mean square error values of Nikon Coolpix8700 camera and FC-09 fisheye lens equipment. Therefore, Nikon Coolpix8700 camera and FC-09 fisheye lens equipment can be considered more stable.
iPhone 4S camera and Olloclip 3 in one fisheye lens equipment should be tested in a photogrammetric study and the results should be interpreted in the light of these data.
5. Conclusion
The main purpose of this study is to test fisheye lens equipment used with mobile phones. In this study, the performance of Olloclip 3 in one fisheye lens used with iPhone 4S mobile phone and Nikon FC-E9 fisheye lens used with Nikon Coolpix8700 camera is analyzed comparing the calibration results based on an equidistant model. The calibration parameters were found to be approximate for these two kinds of hardware. The resolutions of the cameras are the same for these two kinds of hardware. The coordinates of image center point were found approximately close to each other from the calculations for these two kinds of hardware. It was seen that the calibration results of Olloclip 3 in one fisheye lens used with iPhone 4S mobile phone have not shown statistical significant difference results compared to Nikon FC-E9 fisheye lens used with Nikon Coolpix8700. Also it was seen from the results of this study that Olloclip 3 in one fisheye lens has larger focal length than the other.
In the near future, iPhone 4S camera and Olloclip 3 in one fisheye lens and Nikon Coolpix8700 equipment are going to be tested in a photogrammetric case study. In compliance with the results of this study, it is expected from the photogrammetric measurement results that Olloclip 3 in one fisheye lens used with iPhone 4S mobile phone will not show statistical significant difference results compared to Nikon FC-E9 fisheye lens used with Nikon Coolpix8700 which will be used for photogrammetric measurement assessments; besides having larger focal length it is expected to give better results than Nikon FC-E9 fisheye lens used with Nikon Coolpix8700. This experimental study shows that Olloclip 3 in one fisheye lens developed for mobile phones has at least similar characteristics with classic fisheye lenses.
Competing Interests
The author declares that there are no competing interests.
Acknowledgments
In this publication, bundle block adjustment software developed by Dr. Danilo Schneider in Germany Dresden Technical University has been used. The author hereby is thankful to Dr. Ing. Danilo Schneider for the permission of software which was developed by him.
iPhone Lens Kits Reviews, 2015, http://iphone-lens-kits-review.toptenreviews.com/olloclip2015, https://www.olloclip.com/GruenA.AkcaD.Calibration and accuracy testing of mobile phone camerasProceeding of the 28th Asian Conference on Remote Sensing (ACRS '07)November 2007Kuala Lumpur, Malaysia117111772-s2.0-84865662832AydarU.2007Istanbul, TurkeyIstanbul Technical University Graduate School of Science Engineering and TechnologyYamamotoD.OzekiS.TakahashiN.Wired fisheye lens: a motion-based improved fisheye interface for mobile web map services20095886Berlin, GermanySpringer153170Lecture Notes in Computer Science10.1007/978-3-642-10601-9_11AbrahamS.FörstnerW.Fish-eye-stereo calibration and epipolar rectification200559527828810.1016/j.isprsjprs.2005.03.0012-s2.0-22544479762GledhillD.TianG. Y.TaylorD.ClarkeD.Panoramic imaging—a review200327343544510.1016/s0097-8493(03)00038-42-s2.0-0037681600SchwalbeE.Geometric modelling and calibration of fisheye lens camera systemsProceedings of the 2nd Panoramic Photogrammetry Workshop, International Archives of Photogrammetry, RemoteFebruary 2005Berlin, Germany58KumlerJ.BauerM.Fisheye lens designs and their relative performance4093Proceedings of the Current Developments in Lens Design and Optical Systems Engineering (SPIE '00)October 2000San Diego, Calif, USA36036910.1117/12.4052262-s2.0-0034538569DhaneP.KuttyK.BangadkarS.A generic non-linear method for fisheye correction20125110586510.5120/8082-1483YamashitaM.YoshimuraM.NakashizukaT.Cloud cover estimation using multitemporal hemisphere imageriesProceedings of the Photogrammetry and Remote Sensing, 20th ISPRS Congress, Commission VII, WG VII/6 (ISPRS '04)2004Istanbul, Turkey826829WangL.DuanF.LvK.Fisheye-lens-based visual sun compass for perception of spatial orientation201220121546043010.1155/2012/4604302-s2.0-84859736477OhJ. K. W.HaberlJ. S.New educational software for teaching the sunpath diagram and shading mask protractor3–9Proceedings of the 5th International IBPSA Conference: Building Simulation (ESL-PA-97/09-01)September 1997Prague, Czech Republic7KrishnanG.NayarS. K.Cata-fisheye camera for panoramic imagingProceedings of the IEEE Workshop on Applications of Computer Vision (WACV '08)January 2008Copper Mountain, Colo, USA1810.1109/wacv.2008.45440352-s2.0-50849115210StreckelB.Evers-SenneJ. F.KochR.Lens model selection for a markerless AR tracking systemProceedings of the 4th IEEE and ACM International Symposium on Mixed and Augmented RealityOctober 2005Vienna, Austria130133BrunX.DeschaudJ. E.GouletteF.On-the-way city mobile mapping using laser range scanner and fisheye camera8Proceedings of the 5th International Symposium on Mobile Mapping Technology (MMT '07)May 2007Padua, Italy8AhmadA.LimaP.Multi-robot cooperative spherical-object tracking in 3D space based on particle filters201361101084109310.1016/j.robot.2012.12.0082-s2.0-84883854898ZhengJ. Y.LiS.NarayananP. J.NayarS. K.ShumH.-Y.Employing a fish-eye for scene tunnel scanning3851Proceedings of the 7th Asian Conference on Computer Vision (ACCV '06)January 2006Hyderabad, India509518Lecture Notes in Computer Science10.1007/11612032_52MartinezE.Del PobilA. P.A dioptric stereo system for robust real-time people trackingProceeding of the Workshop on People Detection and Tracking in IEEE International Conferance on Robotics and Automation (ICRA '09)May 2009Kobe, JapanGurtnerA.2008Brisbane, AustraliaQueensland University of TechnologyGrelssonB.2014Linköping, SwedishLinköping University Electronic Press, Linköpings UniversitetNaruseT.KanekoT.YamashitaA.AsamaH.3-D measurement of objects in water using fish-eye stereo cameraProceeding of the 19th IEEE International Conference on Image Processing (ICIP '12)October 2012Orlando, Fla, USA2773277610.1109/icip.2012.64674742-s2.0-84875842582BouazizS.2009Lausanne, SwitzerlandVirtual Reality Laboratory, École Polytechnique Fédérale de LausanneGeorgantasA.BrédifM.DesseillignyM. P.An accuracy assessment of automated photogrammetric techniques for 3D modelling of complex interiors39-B3Proceeding of 22th The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (ISPRS '12)September 2012Melbourne, Australia232810.5194/isprsarchives-XXXIX-B3-23-2012SchneiderD.SchwalbeE.Integrated processing of terrestrial laser scanner data and fisheye-camera image dataProceedings of the 21st ISPRS CongresJuly 2008Beijing, China10371044HughesC.DennyP.JonesE.GlavinM.Accuracy of fish-eye lens models201049173338334710.1364/AO.49.0033382-s2.0-77955972502JuniorJ. M.MoraesM. V. A.TommaselliA. M. G.Experimental assessment of techniques for fisheye camera calibration201521363765110.1590/s1982-21702015000300036SchneiderD.SchwalbeE.MaasH.-G.Validation of geometric models for fisheye lenses200964325926610.1016/j.isprsjprs.2009.01.0012-s2.0-67349108120KannalaJ.BrandtS. S.A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses20062881335134010.1109/TPAMI.2006.1532-s2.0-33748169799ParianJ. A.Panoramic imaging: techniques, sensor modeling and applicationsProceedings of the International Summer School on “Digital Recording and 3D Modelling”April 2006Crete, GreeceThirthalaS.PollefeysM.The radial trifocal tensor: a tool for calibrating the radial distortion of wide-angle cameras1Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05)June 2005San Diego, Calif, USA32132810.1109/cvpr.2005.3422-s2.0-24644456973HughesC.GlavinM.JonesE.Simple fish-eye calibration method with accuracy evaluation201110154622-s2.0-84857593294JohnsonK. B.1997Knoxville, Tenn, USAUniversity of TennesseeMiyamotoK.Fish eye lens19645481060106110.1364/josa.54.001060YamashitaM.YoshimuraM.NakashizukaT.Cloud cover estimation using multitemporal hemisphere imageries35Proceedings of the International Society for Photogrammetry and Remote Sensing2004Istanbul, Turkey826829HughesC.DennyP.GlavinM.JonesE.Equidistant fish-eye calibration and rectification by vanishing point extraction201032122289229610.1109/TPAMI.2010.1592-s2.0-78049526721HughesC.McFeelyR.DennyP.GlavinM.JonesE.Equidistant (fθ) fish-eye perspective with application in distortion centre estimation201028353855110.1016/j.imavis.2009.09.001ParhizgarS.2014Saskatchewan, CanadaUniversity of Regina, Master of Applied Science in Software Systems Engineering University of ReginaNikon2015, http://imaging.nikon.com/Image Resource2015, http://www.imaging-resource.com/photo.net2015, http://photo.net/SahinC.2004Kocaeli, TurkeyGebze Institute of Technology, Graduate School of Science Engineering and Sciences