Transforming the generative pretrained transformer into augmented business text writer
Please use this identifier to cite or link to this item:
https://doi.org/10.48693/462
https://doi.org/10.48693/462
Title: | Transforming the generative pretrained transformer into augmented business text writer |
Authors: | Khalil, Faisal Pipa, Gordon |
ORCID of the author: | https://orcid.org/0000-0002-2276-1930 https://orcid.org/0000-0002-3416-2652 |
Abstract: | This study uses transformers architecture of Artificial neural networks to generate artificial business text for a given topic or theme. The implication of the study is to augment the business report writing, and general business writings process with help of generative pretrained transformers (generative pretrained transformer (GPT)) networks. Main focus of study is to provide practical use case for GPTs models with help of big data. Our study model has 355 million model parameters and trained for three months on GPU enable devices using 2.3 billion text tokens(is available as open-source data now). Text tokens are collected with help of rigorous preprocessing, which includes; shortlisting of Subreddits of Fortune 500 companies and industries, listed on US-based social news aggregation online portal called “Reddit”. After shortlisting, millions of submission of users during the five years, are parsed to collect the URLs out of it. 1.8 million working URLs are scrutinized. Business text is parsed, cleaned, and converted into word embeddings out of uniform resoruce locator (URLs). The result shows that both models; conditional interactive and random sampling, generate text paragraphs that are grammatically accurate and stick to the given topic. |
Citations: | Khalil, F., Pipa, G.: Transforming the generative pretrained transformer into augmented business text writer. J Big Data 9, 112 (2022). |
URL: | https://doi.org/10.48693/462 https://osnadocs.ub.uni-osnabrueck.de/handle/ds-2024012910377 |
Subject Keywords: | Natural language generation; Transformers; Business text generator |
Issue Date: | 22-Nov-2022 |
License name: | Attribution 4.0 International |
License url: | http://creativecommons.org/licenses/by/4.0/ |
Type of publication: | Einzelbeitrag in einer wissenschaftlichen Zeitschrift [Article] |
Appears in Collections: | FB08 - Hochschulschriften Open-Access-Publikationsfonds |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Khalil_Pipa_J_BigData_9-122_s40537-022-00663-7_2022.pdf | Article | 1,61 MB | Adobe PDF | Khalil_Pipa_J_BigData_9-122_s40537-022-00663-7_2022.pdf View/Open |
This item is licensed under a Creative Commons License