Open Access
Memory-Efficient Training Methods for Large Language Models
Ivan Volkov
1
,
Isabella Garcia
2
,
Oğuz Arslan
3
,
Henrik Larsen
4
,
Fatma Özdemir
5
,
Isabella Garcia
2
,
Oğuz Arslan
3
,
Henrik Larsen
4
,
Fatma Özdemir
5
1
Saint Petersburg State University, Russia
2
National Autonomous University of Mexico, Mexico
3
Gazi University, Turkey
4
Norwegian University of Science and Technology, Norway
5
Yildiz Technical University, Turkey
Abstract
This systematic review synthesizes current research on this research area. We analyze 200 peer-reviewed studies examining various aspects of the problem. The review identifies key challenges and opportunities, adaptation strategies, and recommendations. Our findings suggest that significant improvements can be achieved with the proposed approach.
Keywords
big data,data analytics,visualization,databases,data mining
How to Cite
Volkov, I., Garcia, I., Arslan, O., Larsen, H., & Özdemir, F. (2021). Memory-Efficient Training Methods for Large Language Models. Nivo Light - International Journal of Research & Innovation, 3(3), 63–69. https://doi.org/10.28051/ojstest-99
References
Smith, J., & Brown, A. (2018). Deep learning applications in urban computing. Journal of Smart Cities, 15(3), 234-251.
Wang, L., Chen, H., & Liu, X. (2017). Energy optimization algorithms for intelligent buildings. Energy and Buildings, 142, 45-58.
García, M., Rodriguez, P., & Martinez, S. (2018). Sustainable urban development: A comprehensive review. Sustainability Science, 13(2), 189-205.
Tanaka, K., & Yamamoto, H. (2016). Smart grid technologies and renewable energy integration. IEEE Transactions on Smart Grid, 7(4), 1892-1901.
Anderson, R., Williams, T., & Davis, M. (2017). Machine learning for demand response systems. Applied Energy, 201, 112-125.