Transforming the generative pretrained transformer into augmented business text writer

Bitte benutzen Sie diese Kennung, um auf die Ressource zu verweisen:
https://doi.org/10.48693/462
Open Access logo originally created by the Public Library of Science (PLoS)
Titel: Transforming the generative pretrained transformer into augmented business text writer
Autor(en): Khalil, Faisal
Pipa, Gordon
ORCID des Autors: https://orcid.org/0000-0002-2276-1930
https://orcid.org/0000-0002-3416-2652
Zusammenfassung: This study uses transformers architecture of Artificial neural networks to generate artificial business text for a given topic or theme. The implication of the study is to augment the business report writing, and general business writings process with help of generative pretrained transformers (generative pretrained transformer (GPT)) networks. Main focus of study is to provide practical use case for GPTs models with help of big data. Our study model has 355 million model parameters and trained for three months on GPU enable devices using 2.3 billion text tokens(is available as open-source data now). Text tokens are collected with help of rigorous preprocessing, which includes; shortlisting of Subreddits of Fortune 500 companies and industries, listed on US-based social news aggregation online portal called “Reddit”. After shortlisting, millions of submission of users during the five years, are parsed to collect the URLs out of it. 1.8 million working URLs are scrutinized. Business text is parsed, cleaned, and converted into word embeddings out of uniform resoruce locator (URLs). The result shows that both models; conditional interactive and random sampling, generate text paragraphs that are grammatically accurate and stick to the given topic.
Bibliografische Angaben: Khalil, F., Pipa, G.: Transforming the generative pretrained transformer into augmented business text writer. J Big Data 9, 112 (2022).
URL: https://doi.org/10.48693/462
https://osnadocs.ub.uni-osnabrueck.de/handle/ds-2024012910377
Schlagworte: Natural language generation; Transformers; Business text generator
Erscheinungsdatum: 22-Nov-2022
Lizenzbezeichnung: Attribution 4.0 International
URL der Lizenz: http://creativecommons.org/licenses/by/4.0/
Publikationstyp: Einzelbeitrag in einer wissenschaftlichen Zeitschrift [Article]
Enthalten in den Sammlungen:FB08 - Hochschulschriften
Open-Access-Publikationsfonds

Dateien zu dieser Ressource:
Datei Beschreibung GrößeFormat 
Khalil_Pipa_J_BigData_9-122_s40537-022-00663-7_2022.pdfArticle1,61 MBAdobe PDF
Khalil_Pipa_J_BigData_9-122_s40537-022-00663-7_2022.pdf
Miniaturbild
Öffnen/Anzeigen


Diese Ressource wurde unter folgender Copyright-Bestimmung veröffentlicht: Lizenz von Creative Commons Creative Commons