In this paper, we study estimation for partial linear models. We assume radial basis functions for the nonparametric component of these models. To obtain the estimated curve with fitness and smoothness of the nonparametric component, we first apply the sufficient dimension reduction method to the radial basis functions. Then, the coefficients of the transformed radial basis functions are estimated. Finally, the coefficients in the parametric component can be estimated. The above procedure is iterated and hence the proposed method is based on an alternating estimation. The proposed method is highly versatile and is applicable not only to mean regression but also quantile regression and general robust regression. The -consistency and asymptotic normality of the estimator are derived. A simulation study is performed and an application to a real dataset is illustrated.
DOI : 10.1051/ps/2015018
Mots-clés : Partial linear model, robust regression, sliced average variance estimation, sliced inverse regression, sufficient dimension reduction
@article{PS_2016__20__1_0, author = {Yoshida, Takuma}, title = {Partially linear estimation using sufficient dimension reduction}, journal = {ESAIM: Probability and Statistics}, pages = {1--17}, publisher = {EDP-Sciences}, volume = {20}, year = {2016}, doi = {10.1051/ps/2015018}, mrnumber = {3519677}, zbl = {1357.62183}, language = {en}, url = {http://archive.numdam.org/articles/10.1051/ps/2015018/} }
TY - JOUR AU - Yoshida, Takuma TI - Partially linear estimation using sufficient dimension reduction JO - ESAIM: Probability and Statistics PY - 2016 SP - 1 EP - 17 VL - 20 PB - EDP-Sciences UR - http://archive.numdam.org/articles/10.1051/ps/2015018/ DO - 10.1051/ps/2015018 LA - en ID - PS_2016__20__1_0 ER -
Yoshida, Takuma. Partially linear estimation using sufficient dimension reduction. ESAIM: Probability and Statistics, Tome 20 (2016), pp. 1-17. doi : 10.1051/ps/2015018. http://archive.numdam.org/articles/10.1051/ps/2015018/
Semiparametric inference in a partial linear model. Ann. Statist. 25 (1997) 244–262. | DOI | MR | Zbl
and ,Generalized partially linear single-index models. J. Amer. Statist. Assoc. 92 (1997) 477–489. | DOI | MR | Zbl
, , and ,Convergence rates for parametric components in a partly linear model. Ann. Statist. 16 (1988) 136–141. | DOI | MR | Zbl
,SIR be as popular as multiple linear regression. Statist. Sinica 8 (1998) 289–316. | MR | Zbl
and ,Sufficient Dimension Reduction in Regressions With Categorical Predictors. Ann. Statist. 30 (2002) 475–497. | DOI | MR | Zbl
, and ,Discussion of “Sliced inverse regression for dimension reduction” by K.C.Li. J. Amer. Statist. Assoc. 86 (1991) 328–332. | DOI | Zbl
and ,Asymptotics of graphical projection pursuit. Ann. Statist. 12 (1984) 793–815. | DOI | MR | Zbl
and ,A partially linear single-index transformation model and its nonparametric estimation. The Canadian J. Statistics 43 (2015) 97–117. | DOI | MR | Zbl
, and ,On spline estimators and prediction intervals in nonparametric smoothing. Comput. Statist. Data Anal. 35 (2000) 67–82. | DOI | MR | Zbl
and ,Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96 (2001) 1348–1360. | DOI | MR | Zbl
andRobust Nonparametric Function Estimation. Scand. J. Statist. 21 (1994) 433–446. | MR | Zbl
, and ,On partial sufficient dimension reduction with applications to partially linear multi-index models. J. Amer. Statist. Assoc. 108 (2013) 237–246. | DOI | MR | Zbl
, , and ,F.R. Hampel, E.M. Ronchetti, P.J. Rousseeuw and W.A. Stahel, Robust Statistics: The approach based on influence functions, Wiley Ser. Probab. Stat. Wiley-Interscience (2005). | MR | Zbl
W. Härdle, Partially Linear Models. Springer, New York (2000).
Hedonic housing pries and the demand for clean air. J. Environ. Econ. Manage. 5 (1978) 81–102. | DOI | Zbl
and ,T. Hastie and R. Tibshirani, Generalized additive models. Chapman & Hall, London (1990) | MR | Zbl
Bivariate tensor-product B-splines in a partially linear regression. J. Multivariate Anal. 58 (1996) 162–181. | DOI | MR | Zbl
and ,Spline smoothing in a partly linear model. J. Roy. Statist. Soc. Ser. A 48 (1986) 244–248. | MR | Zbl
,quantile regression via an MM algorithm. J. Comp. Graph. Statist. 9 (2000) 60–77. | MR
and ,Single-index composite quantile regression. J. Korean Statist. Soc. 41 (2012) 323–332. | DOI | MR | Zbl
, , and ,Limiting distributions for regression estimators under general conditions. Ann. Statist. 26 (1998) 755–770. | DOI | MR | Zbl
,R. Koenker, Quantile regression. Cambridge Univ. Press, Cambridge (2005) | MR | Zbl
Regression quantiles. Econometrica 46 (1978) 33–50. | DOI | MR | Zbl
and ,Efficient semiparametric estimation of a partially linear quantile regression model. Econ. Theory 19 (2003) 1–31. | MR | Zbl
,Robust penalized regression spline fitting with application to additive mixed modeling. Comput. Statist. 22 (2007) 159–171. | DOI | MR | Zbl
and ,Sliced inverse regression for dimension reduction. J. Amer. Statist. Assoc. 102 (1991) 997–1008.
,On directional regression for dimension reduction. J. Amer. Statist. Assoc. 33 (2007) 1580–1616.
and ,Sliced inverse regression with regularizations. Biometrics. 64 (2008) 124–131. | DOI | MR | Zbl
, and ,Asymptotics for sliced average variance estimation. Ann. Statist. 35 (2007) 41–69. | MR | Zbl
and ,Estimation and variable selection for semiparametric additive partial linear models. Statist. Sinica 21 (2011) 1225–1248. | DOI | MR | Zbl
, and ,Asymptotics for least absolute deviation regression estimators. Econ. Theory 7 (1991) 186–199. | DOI | MR
,Semiparametric efficient estimation of partially linear quantile regression models. Ann. Econ. Finance 6 (2005) 105–127.
,Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 (1996) 267–288. | MR | Zbl
,Asymptotic inference for eigenvectors. Ann. Statist. 9 (1981) 725–736. | DOI | MR | Zbl
,Estimation for a partial-linear single-index model. Ann. Statist. 38 (2010) 246–274. | MR | Zbl
, and ,Thin plate regression splines. J. R. Statist. Soc. B. 65 (2003) 95–114. | DOI | MR | Zbl
,Semi-parametric estimation of partially linear single-index models. J. Multivariate Anal. 97 (2006) 1162–1184. | DOI | MR | Zbl
and ,An adaptive estimation of dimension reduction space. J. Roy. Statist. Soc. Ser. B. 64 (2002) 363–410. | DOI | MR | Zbl
, , and ,Penalized spline estimation for partially linear single-index models. J. Amer. Statist. Assoc. 97 (2002) 1042–1054. | DOI | MR | Zbl
and ,Robust estimation for partially linear models with large-dimensional covariates. Science China Mathematics. 56 (2013) 2069–2088. | DOI | MR | Zbl
, and ,Sliced inverse regression with large dimensional covariates. J. Amer. Statist. Assoc. 101 (2006) 630–643. | DOI | MR | Zbl
, and ,Composite quantile regression and the oracle model selection theory. Ann. Statist. 36 (2008) 1108–1126. | MR | Zbl
and ,Cité par Sources :