最近编译Spark的时候,遇到一个问题:
执行SPARK_HADOOP_VERSION=0.20.2-cdh3u5 SPARK_HIVE=true sbt/sbt assembly后,报错:
error: Protocol https not supported or disabled in libcurl while accessing https://github.com/apache/spark.git/info/refs
fatal: HTTP request failed
是在git clone的时候出了问题,怀疑是curl不支持https,在我检查后发现,curl是支持https的。
那就把问题定位到了,git,git在编译的时候估计libcurl是不支持https的。
手工修复的成本太大,修复了很久,这是搜到了一篇stackoverflow讨论此issues的文章:http://stackoverflow.com/questions/19015282/how-do-i-enable-https-support-in-libcurl
评论里有人提到用brew doctor,这个只有Mac OS才有这个软件。不过Linux平台也有移植版linuxbrew
brew是一个类似apt-get, yum 的安装工具包。支持的特性如下:
git clone https://github.com/Homebrew/linuxbrew.git ~/.linuxbrew export PATH="$HOME/.linuxbrew/bin:$PATH" export LD_LIBRARY_PATH="$HOME/.linuxbrew/lib:$LD_LIBRARY_PATH"
[root@wh-8-210 shengli]# brew install git --with-brewed-curl ==> Installing dependencies for git: pkg-config, makedepend, openssl, curl ==> Installing git dependency: pkg-config ==> Downloading http://pkgconfig.freedesktop.org/releases/pkg-config-0.28.tar.gz ......
原创文章:转载请注明出自:http://blog.csdn.net/oopsoom/article/details/39231091
原文地址:http://blog.csdn.net/oopsoom/article/details/39231091