Project detail

Intelligent Management Platform for Advanced Real-Time media processes

Duration: 01.11.2012 — 31.10.2015

Funding resources

Ministerstvo školství, mládeže a tělovýchovy ČR - Sedmý rámcový program Evropského společenství pro atomovou energii (Euratom) v oblasti jaderného výzkumu a vzdělávání

- whole funder (2012-11-01 - 2015-10-31)

On the project

IMPART will research, develop and evaluate intelligent information management solutions for "big data" problems in the field of digital cinema production. It will find new ways of managing, visualising and analysing very large multimodal data sets so that creative personnel can review three-dimensional scene representations on the set, understand the data, identify errors, evaluate the quality of the shot and take creative decisions in real time. We will research and test solutions for the use case of large-scale movie production, with very large research and evaluation datasets based on the latest industrial processes. Results will be applicable to film production and more generally to commercial and professional domains ranging from TV and on-line video to surveillance. The project outcomes will include: - Architectures and file structures for intelligent multimodal data and metadata management, presentation and browsing linking data, metadata and advanced applications - Methods for automatically selecting relevant subsets of data to allow rapid processing - Techniques for processing, information extraction and analysis in distributed systems - Multimodal content semantic and low-level analysis techniques for the automatic derivation of metadata to support visualisation, decision support, management and retrieval - On-set decision support, including tools for multimodal data visualisation, data summarization, layout, registration and cross-referencing, data and metadata search, virtual overlays and real-time previews of effects, creative and technical decision support - A demonstrator system for professional testing and evaluation, both on and off set - A documented xml interface that allows third parties to develop compatible tools and processes - A published test dataset of multimodal data and metadata captured in realistic film production conditions for use by other researchers.

Description in Czech
Projekt IMPART se zaměřuje na výzkum, vývoj a hodnocení řešení inteligentní správy informací pro problémy "velkých dat" v oblasti tvorby digitálního kina. Hledá nové cesty správy, zobrazování a analýzy obrovských multimediálních datových sad s cílem usnadnění práce tvůrčích pracovníků, kteří budou moci prohlížet nasnímané 3D reprezentace scény, porozumět datům, identifikovat chyby, hodnotit kvalitu záběrů a činit závěry v reálném čase.

Keywords
information management; multimodal; metadata; real-time decision support; digital media

Mark

7E13044

Default language

English

People responsible

Ila Viorela Simona, Ph.D. - fellow researcher
Kula Michal, Ing., Ph.D. - fellow researcher
Polok Lukáš, Ing., Ph.D. - fellow researcher
Seeman Michal, Ing., Ph.D. - fellow researcher
Šolony Marek, Ing., Ph.D. - fellow researcher
Smrž Pavel, doc. RNDr., Ph.D. - principal person responsible

Units

Department of Computer Graphics and Multimedia
- beneficiary (2012-09-07 - 2015-10-31)

Results

BAŘINA, D.; ZAHRÁDKA, J.; ZEMČÍK, P. Wavelet Representation of Optical System Distortion. In International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG). Plzeň: Union Agency, 2014. p. 11-16. ISBN: 978-80-86943-71-8.
Detail

POLOK, L.; VINCENT, L.; ILA, V.; DRUMMOND, T.; MAHONY, R. The effect of different parameterisations in incremental structure from motion. In Proceedings of 2015 Australasian Conference on Robotics and Automation, ACRA 2015; Australian National UniversityCanberra; Australia. Australasian Conference on Robotics and Automation, ACRA. Canberra: Australian National University, 2015. p. 1-9. ISSN: 1448-2053.
Detail

BLAT, J.; EVANS, A.; HILTON, A.; IMRE, E.; KIM, H.; NIKOLAIDIS, N.; PITAS, I.; POLOK, L.; SMRŽ, P.; TEFAS, A.; ZEMČÍK, P. IMPART: Big media data processing and analysis for film production. In IEEE International Conference on Multimedia Expo Workshops (ICMEW). Torino: 2015. p. 1-5. ISBN: 978-1-4799-7079-7.
Detail

ILA, V.; POLOK, L.; ŠOLONY, M.; SVOBODA, P. SLAM++-A Highly Efficient and Temporally Scalable Incremental SLAM Framework. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2017, vol. 2017, no. 1, p. 210-230. ISSN: 1741-3176.
Detail

BLAT, J.; EVANS, A.; KIM, H.; IMRE, E.; POLOK, L.; ILA, V.; NIKOLAIDIS, N.; ZEMČÍK, P.; TEFAS, A.; SMRŽ, P.; HILTON, A.; PITAS, I. Big Data Analysis for Media Production. IEEE Communication Letters, 2015, vol. 104, no. 11, p. 2085-2113. ISSN: 1089-7798.
Detail

POLOK, L.; KLICNAR, L.; ZEMČÍK, P.; BERAN, V.; SMRŽ, P. Quality Assurance in Large Collections of Video Sequences. In Proceedings - International Conference on Image Processing, ICIP. Québec: IEEE Computer Society Press, 2015. p. 3580-3584. ISBN: 978-1-4799-8339-1.
Detail

POLOK, L.; ILA, V.; SMRŽ, P. Cache Efficient Implementation for Block Matrix Operations. Proceedings of the 21st High Performance Computing Symposium (HPC'13). San Diego: Association for Computing Machinery, 2013. p. 698-706. ISBN: 1-56555-350-0.
Detail

ILA, V.; POLOK, L.; SMRŽ, P.; ŠOLONY, M.; ZEMČÍK, P. Incremental Cholesky Factorization for Least Squares Problems in Robotics. Proceedings of The 2013 IFAC Intelligent Autonomous Vehicles Symposium. Gold Coast: IEEE Computer Society, 2013. p. 1-8. ISBN: 978-3-902823-36-6.
Detail

ILA, V.; POLOK, L.; SMRŽ, P.; ŠOLONY, M.; ZEMČÍK, P. Incremental Block Cholesky Factorization for Nonlinear Least Squares in Robotics. In proceedings of The Robotics: Science and Systems 2013 Conference. Berlín: MIT Press, 2013. p. 1-8. ISBN: 978-981-07-3937-9.
Detail

BAŘINA, D.; ZEMČÍK, P. Wavelet Lifting on Application Specific Vector Processor. In GraphiCon'2013. Vladivostok: GraphiCon Scientific Society, 2013. p. 83-86. ISBN: 978-5-8044-1402-4.
Detail

VRÁBELOVÁ, P.; BAŘINA, D.; ŠKODA, P.; VÁŽNÝ, J.; ZENDULKA, J. Classification of Spectra of Emission-line Stars Using Feature Extraction Based on Wavelet Transform. In Proceedings of 23rd Annual Astronomical Data Analysis Software and Systems (ADASS) Conference. San Francisco: Astronomical Society of the Pacific, 2013. p. 177-180. ISBN: 978-1-58381-854-1.
Detail

VRÁBELOVÁ, P.; BAŘINA, D.; ŠKODA, P.; ZENDULKA, J.; VÁŽNÝ, J. Classification of Be Stars Using Feature Extraction Based on Discrete Wavelet Transform. Proceedings of conferences Datakon and Znalosti 2013. Ostrava: VŠB-Technical University of Ostrava, 2013. p. 95-102. ISBN: 978-80-248-3189-3.
Detail

BAŘINA, D.; ZEMČÍK, P. Minimum Memory Vectorisation of Wavelet Lifting. In Advanced Concepts for Intelligent Vision Systems (ACIVS). Lecture Notes in Computer Science (LNCS) 8192. Poznan: Springer London, 2013. p. 91-101. ISBN: 978-3-319-02894-1.
Detail

POLOK, L.; ILA, V.; SMRŽ, P. Fast Radix Sort for Sparse Linear Algebra on GPU. Proceedings of the 22nd High Performance Computing Symposium (HPC'14). Tampa: Association for Computing Machinery, 2014. p. 1-8. ISBN: 1-56555-353-5.
Detail

POLOK, L.; ŠOLONY, M.; ILA, V.; SMRŽ, P.; ZEMČÍK, P.; CLIFFORD, J.; PABST, S. A GPU-Accelerated Bundle Adjustment Solver. San Jose: NVIDIA, 2015. p. 1 (1 s.).
Detail

BAŘINA, D.; ZEMČÍK, P. Diagonal Vectorisation of 2-D Wavelet Lifting. In International Conference on Image Processing (ICIP). Paris: IEEE Signal Processing Society, 2014. p. 2978-2982. ISBN: 978-1-4799-5751-4.
Detail

ILA, V.; POLOK, L.; ŠOLONY, M.; ZEMČÍK, P.; SMRŽ, P. Fast Covariance Recovery in Incremental Nonlinear Least Square Solvers. In Proceedings of IEEE International Conference on robotics and Automation. Seattle: IEEE Computer Society, 2015. p. 1-8. ISBN: 978-1-4799-6922-7.
Detail

BAŘINA, D.; ZEMČÍK, P. Vectorization and Parallelization of 2-D Wavelet Lifting. Journal of Real-Time Image Processing, 2018, vol. 15, no. 2, p. 349-361. ISSN: 1861-8200.
Detail

POLOK, L.; ILA, V.; SMRŽ, P. Fast Sparse Matrix Multiplication on GPU. In Proceedings of the 23rd High Performance Computing Symposium (HPC'15). Alexandria, Virginia: Association for Computing Machinery, 2015. p. 1-8. ISBN: 978-1-5108-0101-1.
Detail

ŠOLONY, M.; IMRE, E.; ILA, V.; POLOK, L.; KIM, H.; ZEMČÍK, P. Fast and Accurate Refinement Method for 3D Reconstruction from Stereo Spherical Images. In Proceedings of the 10th International Conference on Computer Vision Theory and Applications. Berlin: Institute of Electrical and Electronics Engineers, 2015. p. 1-8. ISBN: 978-989-8425-47-8.
Detail

PABST, S.; KIM, H.; POLOK, L.; ILA, V.; WAINE, T.; HILTON, A.; CLIFFORD, J.; SMRŽ, P. Jigsaw - Multi-Modal Big Data Management in Digital Film Production. Los Angeles: 2015. p. 1-2. ISBN: 978-1-4503-3632-1.
Detail

SEEMAN, M.; BAŘINA, D.; POLOK, L.; SMRŽ, P.; ZEMČÍK, P.: InFocus; In-Focus detector. http://www.fit.vutbr.cz/research/prod/index.php?file=%2Fproduct%2F412%2Finfocus_2014-12-03_to-FL_.zip&id=412¬itle=1. URL: http://www.fit.vutbr.cz/research/prod/index.php?file=%2Fproduct%2F412%2Finfocus_2014-12-03_to-FL_.zip&id=412¬itle=1. (software)
Detail

BAŘINA, D.; ZAHRÁDKA, J.; ZEMČÍK, P.: calib-dwt; Framework for Wavelet Representation of Optical System Distortion. http://www.fit.vutbr.cz/research/prod/?id=367. URL: http://www.fit.vutbr.cz/research/prod/?id=367. (software)
Detail

KLICNAR, L.; BERAN, V.; POLOK, L.; BAŘINA, D.; SMRŽ, P.; ZEMČÍK, P.: VideoSync; Video Synchronization Tool. VideoSynchronization.zip. URL: https://www.fit.vut.cz/research/product/450/. (software)
Detail

POLOK, L.; SEEMAN, M.; ILA, V.; SMRŽ, P.; ŠOLONY, M.; ZEMČÍK, P.: SNAPPI; SNAPPER Image Postprocess. http://www.fit.vutbr.cz/research/prod/index.php?id=327. URL: http://www.fit.vutbr.cz/research/prod/index.php?id=327. (software)
Detail

POLOK, L.; ILA, V.; SEEMAN, M.; SMRŽ, P.; SVOBODA, A.; ŠOLONY, M.; ZEMČÍK, P.: ADPXDec; Accelerated DPX decoder. http://www.fit.vutbr.cz/research/prod/index.php?id=326. URL: http://www.fit.vutbr.cz/research/prod/index.php?id=326. (software)
Detail

POLOK, L.; ILA, V.; SMRŽ, P.; SVOBODA, P.; ŠOLONY, M.; ZEMČÍK, P.: GPUSM; GPU Accelerated Similarity Matrix Module. http://www.fit.vutbr.cz/research/prod/index.php?file=%2Fproduct%2F302%2FSimilarityMatrix_on_GPU_src.zip&id=302¬itle=1. URL: http://www.fit.vutbr.cz/research/prod/index.php?file=%2Fproduct%2F302%2FSimilarityMatrix_on_GPU_src.zip&id=302¬itle=1. (software)
Detail

Responsibility: Smrž Pavel, doc. RNDr., Ph.D.