Show simple item record

dc.contributor.authorUrda, Daniel
dc.contributor.authorVeredas Navarro, Francisco Javier
dc.contributor.authorGonzález Enrique, Francisco Javier 
dc.contributor.authorRuiz Águilar, Juan Jesús 
dc.contributor.authorJerez Aragonés, José Manuel
dc.contributor.authorTurias Domínguez, Ignacio José 
dc.contributor.otherIngeniería Industrial e Ingeniería Civiles_ES
dc.contributor.otherIngeniería Informáticaes_ES
dc.date.accessioned2025-01-31T08:52:18Z
dc.date.available2025-01-31T08:52:18Z
dc.date.issued2021
dc.identifier.issn1433-3058
dc.identifier.urihttp://hdl.handle.net/10498/35219
dc.description.abstractDeep learning provides a variety of neural network-based models, known as deep neural networks (DNNs), which are being successfully used in several domains to build highly accurate predictors. A key factor which usually makes DNNs to outperform traditional machine learning models is the amount of data that is nowadays accessible and available. Nevertheless, there are other factors linked to DNNs topologies that may also have influence on the predictive performance of DNN models. In particular, fully connected deep neural networks (fc-DNNs) typically struggle in achieving good performance rates when applied to small datasets. This is due to the high number of parameters which need to be learned when training this kind of models, which makes them prone to over-fitting issues. In this paper, authors propose the use of problem-specific information in order to impose constraints to network architecture so that a fc-DNN is transformed into a partially connected DNN (pc-DNN), in such a way that network topology is driven by prior knowledge. This work compares two baseline models, the elastic net and fc-DNNs, to pc-DNNs applied on three synthetic datasets with different number of samples. Synthetic data was generated to estimate the goodness of using problem-specific information to drive network architectures. Furthermore, a similar analysis is performed herein on a real-world problem dataset to show the benefits of pc-DNN models in term of predictive performance. The results of the analysis showed that pc-DNNs with built-in problem-specific information clearly outperformed the elastic net and fc-DNNs in most of the datasets used, in either synthetic or real-world problems. The pc-DNNs turned out to be a useful model, especially when it is applied to small- or medium-size datasets, on which it significantly outperformed the baseline models considered in this study. Specifically, the pc-DNNs achieved AUC and MSE improvement rates of (8.21%, 19.79%) and (6.65%, 20.54%) in small- and medium-size datasets for both case studies analyzed, the synthetic and real-world problem, respectively.es_ES
dc.formatapplication/pdfes_ES
dc.language.isoenges_ES
dc.publisherSpringer Naturees_ES
dc.sourceNeural Computing and Applications - 2021, Vol. 33 pp. 9403–9423es_ES
dc.subjectDeep learninges_ES
dc.subjectPrior knowledgees_ES
dc.subjectDeep neural networkses_ES
dc.subjectData-driven topologyes_ES
dc.subjectData-scarce settingses_ES
dc.subjectPredictive modelinges_ES
dc.subjectAir qualityes_ES
dc.titleDeep neural networks architecture driven by problem-specific informationes_ES
dc.typejournal articlees_ES
dc.rights.accessRightsclosed accesses_ES
dc.identifier.doi10.1007/S00521-021-05702-7
dc.type.hasVersionVoRes_ES


Files in this item

This item appears in the following Collection(s)

Show simple item record