In pace with the advancements in interactive 3DTV technology, the content of 3D data repositories has been evolved rapidly not only quantitatively but also qualitatively. Emerging 3D data in particular those associated with multiviews and depth information facilitates the creation of perceptually appealing displays and animations. The trend in virtual reality (VR) and augmented reality (AR) is towards the integration of traditional 2D and latest 3D methodologies to meet the demands in many industrial and research applications like advertising, movies, entertainments, social web such as Second Life, GOOGLE map and so on. To enhance users’ perceptual experiences beyond the 2D horizon, many rendering techniques, such as immersion, stereo and multiviews, have been adopted not only in IMAX theatres, but also in household commodity systems. State-of-the-art 3D viewing techniques have become hot topics in multi-disciplinary research. Nevertheless, a challenging issue continues to be improving user perceptual experience and measuring user satisfaction, based on which computational model(s) can be developed for content assessment. The August 2011 E-Letter presented an excellent discussion on Quality of Experience (QoE). This special issue is dedicated to the 3D aspect of data evaluation, retrieval and privacy.