Luminous Studio

Luminous Studio

Developer(s)	Square Enix
Initial release	June 2012
Platform	PlayStation 4, Xbox One, Microsoft Windows
Type	Game engine
License	Proprietary

Luminous Studio (ルミナス・スタジオ Ruminasu Sutajio) is a multi-platform game engine developed and used internally by Square Enix. The engine was developed for and targeted at eighth-generation hardware and DirectX 11-compatible platforms, such as Xbox One, the PlayStation 4, and versions of Microsoft Windows. It was conceived during the development of Final Fantasy XIII-2 to be compatible with next generation consoles that their existing platform, Crystal Tools, could not handle.

The engine powered the Agni's Philosophy and Witch Chapter 0 tech demos and now centers on Final Fantasy XV, a title in the Final Fantasy series for eighth-generation consoles. Critics praised the engine's two tech demos, citing their graphics and real time rendering and declaring the engine as representative of the future of gaming.

Development

Origins

According to Julien Merceron, the Worldwide Technology Director for Square Enix in the early 2010's, the concept for the new engine was born in 2011 while he was in the final stages of working on Final Fantasy XIII-2. This was a difficult period for Square Enix: the project then known as Final Fantasy Versus XIII was hitting technical barriers as it transitioned to open world environments its original Crystal Tools engine could not handle, and Final Fantasy XIV had met with a disastrous launch due to development and technical problems. Faced with these issues, Square Enix decided to bring in former developers from Sega to create new engines for their products, including Luminous Studio. Talking about sharing the engine, Merceron said that he advised the company to avoid sharing between companies or internally between games until the engine had been finalized with the released game: this resulted in Luminous Studio being restricted to what would become Final Fantasy XV during development, while other major next-generation titles would use other outsourced engines.^[1][2]

The construction of Luminous was similar in concept to Epic Games' Unreal Engine or the Unity engine from Unity Technologies in that it incorporated all the development tools needed from asset editing onward, as well as being "high quality, easy to use, flexible, high speed, compact, and supporting both manual and automatic [game development methods]." The development team drew inspiration for this concept and approach from Unreal Engine and CryTek's CryEngine. The name "Luminous" was chosen to reflect the crystal theme of the Final Fantasy series.^[3] There were many major factors that the team considered while building the engine, as they wanted to insure the highest possible quality for high-end games. Some of the environmental factors included lighting, shading and modeling. A core feature of the gameplay was the artificial intelligence (AI), which had previous been liable to become unstable or poor under certain conditions or with poor programming due to the large amount of individual codes needed. For Luminous, the team created a single unifying flexible framework to control the scale of the AI while also making it intuitive. It was intended to be used in-house rather than licensed out to other developers, but that western subsidiaries of the company would have access to it.^[3] In addition, they also built in the ability to blend graphical assets designed for CG scenery with highly advanced real-time animation, making the two graphically similar.^[4] Luminous Studio was publicly revealed in 2011.^[3]

The head of the project was Yoshihisa Hashimoto, Square Enix's Chief Technology Officer, who had moved over to the company from Sonic Team in 2009 and became involved with development in 2011.^[2][5] Other key Square Enix staff members working on Luminous Studio include Takeshi Nozue, Akira Iwata and Hiroshi Iwasaki.^[6] While ground work was being laid for Luminous, members of the team traveled to look at engine technology being developed by IO Interactive, Crystal Dynamics and Eidos Montréal, western video game developers who became subsidiaries after the company bought out Eidos Interactive. Square Enix's western subsidiaries shared information about game engine development from their experience developing the CDC and Glacier 2 game engines and shared their source code with the Luminous Studio team.^[3] During 2012, one third of the final development team was from western subsidiaries of the company.^[4] Luminous was developed based on high-end DirectX 11 technology. While designed for eighth-generation video games, it was said to also be compatible with any console and hardware that could handle shaders, such as PlayStation 3 and Xbox 360. Its compatibility with Nintendo's seventh-gen hardware such as the Wii and Nintendo 3DS was doubted, as those consoles did not support shaders. During this early stage, they were looking into the possibility of adjusting the engine for use on Wii U. The company were hoping to promote Luminous as a kind of brand, showing off the logo and tech demo when they were ready.^[3]

Agni's Philosophy

Preview of the gaming engine while editing after a showing of "Agni's Philosophy" at E3 in 2012

Agni's Philosophy is a tech demo created by Square Enix to show off the capacities of Luminous Studio. The demo was a collaboration between the cinematic Visual Works division -- a section of the company generally associated with CGI movie production for the company's video games -- and Square Enix's R&D department, Advanced Technology Division, with a goal to create a real-time graphics tech demo that has a quality coming as close as possible to pre-rendered CGI.^[3][7] Development of the demo took approximately half a year. Unlike previous technology demos created by the company, which were based on pre-existing games, Square Enix decided to create something completely original. The demo was themed around the Final Fantasy series: during discussions, the team asked the question "What is Final Fantasy?", broke down its basic components and used them, along with added unusual elements, in the demo. A focus during the demo's development was the creation of Agni, the central character. For the demo, as it was a work-in-progress, they optimized it for graphical performance. While the story and themes were created by the Japanese staff, many of the character designs were done by staff from their western subsidiaries. The technology to create the demo was all sourced from then-existing high-end PCs.^[4] An initial mock up of Agni's hair was created using a mannequin and wig styled by a professional make-up artist. Each character's face was constructed around mo-capped footage of live actors, then tweaked and expanded in post-production.^[8] The entire development process, from conception through development, took approximately a year.^[4] Agni's Philosophy was first shown at E3 2012 as part of a special presentation by Square Enix. As part of the presentation, guest speakers paused the demo and adjusted elements of the characters on the fly to show off the engine's customization features.^[9] It was also shown at SIGGRAPH 2012.^[7]

The Agni's Philosophy tech demo was running at 60 frames per second, used 1.8 GB of texture data per frame, and pushed ten million polygons per frame,^[10] with approximately 300,000 to 400,000 polygons for each character model.^[11] The entire city in the demo was tessellated.^[10] There is a scene where 100,000 illuminated firefly-like insects appear on screen, each one a full polygon mesh model with body and wings, which proceed to merge to generate a summoned monster. Production for the demo began in June 2011, and was initially produced as pre-rendered CGI animation by Visual Works before Square Enix attempted to reproduce it entirely in real-time with the Luminous Studio engine, using the same assets as the CGI version.^[6]

Final Fantasy XV

Prior to its rebranding and full move onto eighth-generation consoles, Final Fantasy XV (then called Final Fantasy Versus XIII) used lighting technology from Luminous along with a purpose-built proprietary gameplay engine.^[12] For its E3 2013 re-reveal under its new title, the company used a specially-created engine environment named Ebony.^[13] In July 2014, Hashimoto left the company, citing personal reasons. While still working as an advisor for Luminous Studio, his position as project leader was filled by Remi Driancourt, a senior engineer who had worked with games featuring Luminous technology.^[5] The version of XV shown off at Tokyo Game Show and Jump Festa that year ran on Luminous 1.4, which combined Luminous with components created for Ebony. The Episode Duscae game demo ran on version 1.5, and the developers plan for the final game to run on version 2.0.^[14]

With Luminous Studio, real-time scenes in XV have five million polygons per frame,^[15] with character models made up of about 100,000 polygons each.^[11] Character models for XV were constructed with 600 bones, estimated as roughly 10-12 times more than seventh generation hardware.^[15] About 150 bones are used for the face, 300 for the hair and clothes, and 150 for the body.^[11] For the characters' hair, the team used the same technique as with the characters in Agni's Philosophy.^[16] The inner hair for each character uses about 20,000 polygons, five times more than seventh generation hardware. The data capacity for textures is also much greater than before.^[15] Each character uses 30 MB of texture data, and ten levels of detail. While seventh-generation games used 50 to 100 MB of texture data for a scene, Final Fantasy XV can use about sixteen times this amount on the PlayStation 4 console. 2048×2048 and 4096×4096 texels are used for the HD textures.^[11]

Witch Chapter 0

In April 2015, Square Enix announced that the engine will support DirectX 12, and Nvidia revealed a new real-time tech demo developed by Square Enix for the engine, called Witch Chapter 0 [cry], featuring the character Agni from the earlier Agni's Philosophy demo.^[17] The demo renders over 63 million polygons per frame, uses "8K by 8K" resolution textures, and her hair is rendered with over 50 shaders, with each strand of hair rendered as a polygon. It also portrays human crying with a high level of detail, and the quality of the real-time graphics have been compared to pre-rendered CGI animation. The tech demo took a year to produce, and was running on a PC with four GeForce GTX Titan X graphics cards.^[18]

Features

• Ambient occlusion, including shadows, spherical harmonics and screen space ambient occlusion^[19]
• Animation system, including character bone animation, animation AI routines,^[20] full body IK (inverse kinematics), procedural animation,^[21] and muscle based facial animation^[19]
• Anti-aliasing, including MSAA, FXAA,^[10] and Yebis 2 image-based anti-aliasing^[22]
• Artificial intelligence,^[21] including reactive AI,^[3] animation AI,^[20] and GPGPU support^[3]
• Deferred rendering, including deferred lighting (light pre-pass rendering)^[3]
• Depth buffering^[19]
• Development tools, modules and software for level editing, animation, game editing and shader authoring^[3]
• DirectX 11^[21] and DirectX 12^[23] support
• Dynamic day-night cycle, including time of day cycling^[20]
  • Dynamic cloud system, including full cloud simulation^[20]
• Environment mapping,^[19] including cube mapping^[20]
• Eye shader, including specular reflection, highlighting, refraction, tears,^[19] and eyeball shader,^[24] including eye depth and transparency layer^[19]
• Global illumination,^[20] including real-time global illumination,^[25] indirect illumination^[26] and real-time glossy indirect illumination^[27]
  • Fast global illumination baking via ray-bundle tracing, including radiance exchange via rasterisation, ray direction sampling, fast lightmap baking via tessellation, and ray-bundle tracing, with performance of 200 million rays per second on GTX 580^[26]
  • Adaptive ray-bundle tracing, using adaptive tiling technique with memory usage prediction, an acceleration technique to efficiently generate lightmaps for fast global illumination in large scenes^[28]
  • Path tracing, including real-time bidirectional path tracing via rasterisation, bidirectional sampling, and artifact suppression technique for glossy surfaces^[29]
  • Ray tracing solutions, including ray tracing approximation^[19] and fake ray tracing shader^[24]
• GPGPU and multi-core support, including GPGPU acceleration and GPGPU support for AI and physical simulation^[3]
• GPU computation, for particles, hair, cloth and visual effects^[7]
• Hair simulation, for hair and beard,^[7] including hair simulation shader, GPU accelerated hair simulation,^[7] software to render hair using mannequin technique,^[16] hair shading, hair lighting, scattering, specular reflection,^[19] hair physics,^[6] tessellation, strand smoothing, spline interpolation,^[7] and real-time adjustment of color, frizz, volume, style^[19] length and physics^[6]
  • Geometry shader for hair volume^[19]
  • NURBS based geometry for hair and beard,^[19] including NURB curves, B-splines and T-splines^[16]
  • 50 hair shaders^[18]
• High-dynamic-range rendering,^[24] including HDR lighting^[20]
• Lighting, including refraction, reflection,^[25] diffuse reflection, specular reflection,^[19] volumetric lighting,^[30] per-pixel lighting, and per-pixel order-independent transparency^[26]
  • Subsurface scattering, such as for skin^[19] and clothing^[20]
• Levels of detail^[11] (LOD)^[20]
• Maya software support^[24]
• Materials system,^[20] including glass rendering^[7]
• Motion capture,^[8] including facial motion capture^[19]
• Occlusion culling,^[11] including point cloud culling for imperfect shadow maps^[27]
• Particle system,^[25] including GPU accelerated particle system,^[20] particle effects, independent particles, collision handling, alpha blending, particle buffering, parallel particle updating, and individual particle adjustment of position, velocity and other properties^[7]
• Physically based rendering^[20]
• Physics simulation,^[3] including cloth simulation^[20] with real-time adjustment,^[6] water effects such as ripples, adjustable wind simulation affecting environment (such as grass) and characters (such as clothes),^[20] and GPGPU support^[3]
• Shadow generation,^[24] including shadow mapping^[27] and percentage closer filtering (PCF)^[19]
• Skin shader, including texture coordinate system, shadows, and skin lighting, including diffuse reflection, specular reflection and subsurface scattering^[19]
• Tessellation,^[25] including isoline tessellation and B-spline smoothing tessellation^[16]
• Water reflection, including screen-space reflection and cube mapping^[20]
• Texture resolutions: 2048x2048, 4096x4096,^[11] 8K by 8K^[18]
• Yebis 2 middleware^[20] for post-processing,^[24] including HDR based exposure simulation, color temperature adjustment, depth of field,^[19] bokeh, chromatic aberration,^[31] and motion blur^[32]

Reception

The existence of the gaming engine surprised many critics when it was unveiled in E3 2012.^[33] Kotaku described the graphics of the game engine preview as "jaw dropping" and "stunning", and called it a real competitor to Unreal Engine 4.^[34][35] VG24/7 called the graphics "drop dead gorgeous".^[36] IGN cited the technology as a "hurdling leap into the future", and other reviews emphasised realistic 3D modeling of the human eye and real time rendering of graphics.^[37][38][39]

See also

• List of game engines
• CryEngine
• Dunia Engine
• Fox Engine
• Panta Rhei (game engine)
• Unreal Engine

References

1. Skypirate (2015-12-22). "Julien Merceron revient sur sa carrière chez Square Enix" (in French). FFDream. Archived from the original on 2015-12-23. Retrieved 2015-12-23.
2. Makuzawa, Red (2015-12-22). "Former Luminous Engine Lead talks transition from Final Fantasy Versus XIII to Final Fantasy XV". Nova Crystallis. Archived from the original on 2015-12-23. Retrieved 2015-12-23.
3. "西川善司の3Dゲームファンのための「Luminous Studio」講座 スクウェア・エニックスが開発中の次世代ゲームエンジンの秘密に迫る！". Impress Watch. 2011-08-26. Archived from the original on 2011-11-12. Retrieved 2014-12-22.
4. Donaldson, Alex (2012-06-25). "Square Enix Luminous Studio Interview". RPG Site. Archived from the original on 2014-07-16. Retrieved 2014-12-22.
5. Corriea, Alexa Ray (2014-07-25). "Square Enix's CTO and Final Fantasy 14 tech director has left the company". Polygon. Vox Media. Retrieved 2014-12-23.
6. Van Duine, Erren (2012-06-28). "Agni's Philosophy Final Fantasy Realtime Tech Demo Impressions". RPG Site.
7. "Practical Applications of Compute for Simulation in Agni's Philosophy: Final Fantasy Real Time Tech Demo" (PDF). Square Enix. Retrieved 2016-04-26.
8. Zenji, Nishikawa (2012-08-21). "［CEDEC 2012］メイキングオブ「Agni's Philosophy」。スクエニの次世代ゲームエンジン「Luminous Studio」を使った技術デモ，その開発秘話". 4Gamer. Retrieved 2014-12-23.
9. Graft, Kris (2012-06-05). "Square Enix lifts the lid on its next-gen engine". Gamasutra. UBM. Retrieved 2016-04-26.
10. Papadopoulos, John (2012-12-15). "Agni's Philosophy – Characters Tech Demos – System Specs Revealed – New Details Unveiled". DSOGaming. Retrieved 2016-04-26.
11. "FFXV Luminous Studios Developer Interview Part 1". 2015-01-30. Retrieved 2016-05-23.
12. Gantayat, Anoop (2011-09-21). "Why is Final Fantasy Versus XIII Using the Luminous Engine?". Andriasang. Archived from the original on 2012-07-13.
13. "『ファイナルファンタジーXV』の実機によるデモプレイもお披露目！　『FF零式 HD』緊急トークショウリポート【TGS 2014】". Famitsu. Enterbrain, Inc. 2014-09-20. Archived from the original on 2014-09-20. Retrieved 2014-09-20.
14. Romano, Sal (2014-10-30). "Final Fantasy XV shown behind closed doors at Paris Games Week [Update 3: Footage leaked]". Gematsu. Crave Online. Retrieved 2014-12-23.
15. Romano, Sal (2014-12-22). "Final Fantasy XV further detailed in Famitsu". Gematsu. Crave Online. Archived from the original on 2014-12-22. Retrieved 2014-12-22.
16. Ashcraft, Brian (2015-02-19). "Why Final Fantasy XV Has Fantastic Hair". Kotaku. Gawker Media. Archived from the original on 2015-02-19. Retrieved 2015-02-19.
17. Romano, Sal (2015-04-30). "Square Enix showcases Witch Chapter 0 [Cry] Luminous Engine DirectX 12 tech demo". Gematsu. Crave Online. Retrieved 2015-06-06.
18. White, Jay (2015-04-30). "Square Enix, Microsoft, NVIDIA Point Way Through Uncanny Valley at Microsoft BUILD". Nvidia. Retrieved 2015-06-06.
19. "AGNI'S PHILOSOPHY" course for 3D gaming fan of Nishikawa Zenji". Game Watch. Impress Corporation. Archived from the original on 2012-06-15. Retrieved 2016-05-23.
20. Linneman, John (2015-03-21). "Tech Analysis: Final Fantasy 15 Episode Duscae". Eurogamer. Retrieved 2016-05-23.
21. Gantayat, Anoop (2011-08-26). "Square Enix Details Luminous Studio". Andriasang. Retrieved 2015-06-06.
22. "Post-process Anti-aliasing". Silicon Studio. Retrieved 2015-06-06.
23. McWhertor, Michael (2015-04-30). "Square Enix shows off newest Final Fantasy graphics tech in DirectX 12 demo". Polygon. Vox Media. Retrieved 2015-06-06.
24. Gantayat, Anoop (2012-06-13). "Luminous Engine and Agni's Philosophy Pics and Details". Andriasang. Retrieved 2015-06-06.
25. Yoshihisa Hashimoto. "Luminous studio tech demo". Square Enix. Archived from the original on 2016-06-29.
26. "Fast Global Illumination Baking via Ray-Bundles (sap_0046)" (PDF). Square Enix.
27. "Publications - Advanced Technology Division". Square Enix. Archived from the original on 2013-03-01.
28. "Adaptive Ray-bundle Tracing with Memory Usage Prediction" (PDF). Square Enix. 2013. Retrieved 2015-06-06.
29. "Real-Time Bidirectional Path Tracing via Rasterization" (PDF). Square Enix. 2013. Retrieved 2015-06-06.
30. Prahl, Kyle (2013-02-20). "Square Enix shows off Luminous tech demo on PS4". PlayStation Universe. Retrieved 2015-06-06.
31. "FFXV - Quelques détails sur son moteur" (in French). Gamekyo. Retrieved 2015-06-06.
32. "Key new features of YEBIS 3". Silicon Studio. Retrieved 2015-06-06.
33. Yoon, Andrew (2013-01-13). "How Luminous Studio is preparing Square Enix for the next-gen". Shack News. Retrieved 2015-06-23.
34. Toshi, Nakamura (2012-06-07). "That Stunning New Final Fantasy Tech? That's Not For Sale". Kotaku. Retrieved 2015-06-23.
35. Narcisse, Evan (2012-06-06). "I Saw Square Enixs Jaw Dropping Luminous Studio Engine Running. It's For Real". Kotaku. Retrieved 2015-06-23.
36. Nunneley, Stephany (2012-06-05). "Luminous Engine demo shots are drop dead gorgeous". VG24/7. Retrieved 2016-05-23.
37. Nix, Marc (2012-06-05). "E3 2012: SQUARE ENIX PRESENTS THE LUMINOUS STUDIO ENGINE". IGN. Retrieved 2016-05-23.
38. Plunkett, Luke (2012-12-16). "Square Enix's Next-Gen Engine Sure Makes Eyeballs Look Pretty". Kotaku. Retrieved 2016-05-24.
39. Hillier, Brenna (2012-06-06). "Square Enix's new Luminous Engine demo is amazing". VG24/7. Retrieved 2016-05-24.