当前位置:文档之家› logistic回归模型总结

logistic回归模型总结

[转载]logistic回归模型总结logistic回归模型是最成熟也是应用最广泛的分类模型,通过学习和实践拟通过从入门、进阶到高级的过程对其进行总结,以便加深自己的理解也为对此有兴趣者提供学习的便利。

一、有关logistic的基本概念logistic回归主要用来预测离散因变量与一组解释变量之间的关系最常用的是二值型logistic。

即因变量的取值只包含两个类别例如:好、坏;发生、不发生;常用Y=1或Y=0表示X表示解释变量则P(Y=1|X)表示在X的条件下Y=1的概率,logistic回归的数学表达式为:log(p/1-p)=A+BX =L其中p/1-p称为优势比(ODDS)即发生与不发生的概率之比可以根据上式反求出P(Y=1|X)=1/(1+e^-L)根据样本资料可以通过最大似然估计计算出模型的参数然后根据求出的模型进行预测下面介绍logistic回归在SAS中的实现以及输出结果的解释二、logistic回归模型初步SAS中logistic回归输出结果主要包括预测模型的评价以及模型的参数预测模型的评价与多元线性回归模型的评价类似主要从以下几个层次进行(1)模型的整体拟合优度主要评价预测值与观测值之间的总体一致性。

可以通过以下两个指标来进行检验1、Hosmer-Lemeshowz指标HL统计量的原假设Ho是预测值和观测值之间无显著差异,因此HL指标的P-Value的值越大,越不能拒绝原假设,即说明模型很好的拟合了数据。

在SAS中这个指标可以用LACKFIT选项进行调用2、AIC和SC指标即池雷准则和施瓦茨准则与线性回归类似AIC和SC越小说明模型拟合的越好(2)从整体上看解释变量对因变量有无解释作用相当于多元回归中的F检验在logistic回归中可以通过似然比(likelihood ratiotest)进行检验(3)解释变量解释在多大程度上解释了因变量与线性回归中的R^2作用类似在logistic回归中可以通过Rsquare和C统计量进行度量在SAS中通过RSQ来调用Rsquare,C统计量自动输出(4)模型评价指标汇总<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font: minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:mi nor-latin">统计量<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:mi nor-latin">趋势<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font: minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:mi nor-latin">拟合<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font: minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">作用SAS<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-f ont-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">调用命令<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font: minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:mi nor-latin">备注AIC<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-f ont-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">、SC<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越小<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越好<td width="197" valign="top"style="width:117.9pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">类似与多元回归中的残差平方和<td width="177" valign="top"style="width:106.3pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">模型自动输出<td width="123" valign="top"style="width:73.75pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:mi nor-latin">似然比卡方<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越大<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越好<td width="197" valign="top"style="width:117.9pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">类似与多元回归中的回归平方和<td width="177" valign="top"style="width:106.3pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">自动输出<td width="123" valign="top"style="width:73.75pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt">P<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-fo nt-family:Calibri;mso-hansi-theme-font:minor-latin">值越小越好RSQUARE<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越大<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越好<td width="197" valign="top"style="width:117.9pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">类似与多元回归中的R^2<td width="177" valign="top"style="width:106.3pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">用RSQ<spanstyle="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">选项调用<td width="123" valign="top"style="width:73.75pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt">C<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-f ont-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">统计量<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越大<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越好<td width="197" valign="top"style="width:117.9pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">度量观测值和条件预测的相对一致性<td width="177" valign="top"style="width:106.3pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">自动输出<td width="123" valign="top"style="width:73.75pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt">HL<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-f ont-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">统计量<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越小<td valign="top"style="border-top:none;border-left:none;border-botto m:solid windowtext 1.0pt;border-right:solid windowtext1.0pt;mso-border-top-alt:solid windowtext .5pt;mso-border-left-alt:solidwindowtext .5pt;mso-border-alt:solid windowtext .5pt; padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">越好<td width="197" valign="top"style="width:117.9pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">度量观测值和预测值总体的一致性<td width="177" valign="top"style="width:106.3pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt"><span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-fa mily:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">用LACKFIT<spanstyle="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:minor-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-font-family:Calibri;mso-hansi-theme-font:minor-latin">选项调用<td width="123" valign="top"style="width:73.75pt;border-top:none;border-left: none;border-bottom:solid windowtext1.0pt;border-right:solid windowtext 1.0pt;mso-border-top-alt:solidwindowtext .5pt;mso-border-left-alt:solid windowtext .5pt;mso-border-alt:solid windowtext .5pt;padding:0cm 5.4pt 0cm 5.4pt">P<span style="font-family:宋体;mso-ascii-font-family:Calibri;mso-ascii-theme-font:min or-latin;mso-fareast-font-family:宋体;mso-fareast-theme-font:minor-fareast;mso-hansi-fo nt-family:Calibri;mso-hansi-theme-font:minor-latin">值越大越好。

相关主题