VS10 & Parallel Builds?

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

VS10 & Parallel Builds?

Daniel Dunbar
Hi,

Has anyone tried using msbuild and the CMake generated project files
to do parallel builds?

I ask because I see spurious failures when doing so. MSBuild ends up
complaining about not being able to write the log files for the custom
builds steps, because they are already in use.

I suspect this is a CMake or MSBuild bug, but I don't know enough to
track it down. Does anyone else have any hints?

Here is an example of the kind of failures I see:
--
Build FAILED.

       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\LLVM.sln"
(default target) (1) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\.\ALL_BUILD.vcxproj.metaproj"
(default target) (2) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\lib\Target\X86\AsmParser\LLVMX86AsmParser.vcxproj.metaproj"
(default target) (29) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\lib\Target\X86\LLVMX86CodeGen.vcxproj.metaproj"
(default target) (30) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\lib\Target\X86\LLVMX86CodeGen.vcxproj"
(default target) (168) ->
       (ClCompile target) ->
         C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\lib\Target\X86\X86GenRegisterInfo.inc(4360):
warning C4065: switch statement contains 'default' but no 'case'
labels [C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\lib\Target\X86\LLVMX86CodeGen.vcxproj]


       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\LLVM.sln"
(default target) (1) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\.\ALL_BUILD.vcxproj.metaproj"
(default target) (2) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\tools\c-index-test\c-index-test.vcxproj.metaproj"
(default target) (40) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\tools\libclang\libclang.vcxproj.metaproj"
(default target) (41) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\lib\Frontend\clangFrontend.vcxproj.metaproj"
(default target) (42) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\include\clang\AST\ClangDeclNodes.vcxproj.metaproj"
(default target) (45) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\include\clang\AST\ClangDeclNodes.vcxproj"
(default target) (121) ->
       (CustomBuild target) ->
         C:\Program
Files\MSBuild\Microsoft.Cpp\v4.0\Microsoft.CppCommon.targets(151,5):
error MSB6003: The specified task executable "cmd.exe" could not be
run. The process cannot access the file
'C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\include\clang\AST\Release\custombuild.write.1.tlog'
because it is being used by another process.
[C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\include\clang\AST\ClangDeclNodes.vcxproj]


       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\LLVM.sln"
(default target) (1) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\.\ALL_BUILD.vcxproj.metaproj"
(default target) (2) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\tools\c-index-test\c-index-test.vcxproj.metaproj"
(default target) (40) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\tools\libclang\libclang.vcxproj.metaproj"
(default target) (41) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\lib\Frontend\clangFrontend.vcxproj.metaproj"
(default target) (42) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\include\clang\Basic\ClangDiagnosticLex.vcxproj.metaproj"
(default target) (48) ->
       "C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\include\clang\Basic\ClangDiagnosticLex.vcxproj"
(default target) (119) ->
         C:\Program
Files\MSBuild\Microsoft.Cpp\v4.0\Microsoft.CppCommon.targets(151,5):
error MSB6003: The specified task executable "cmd.exe" could not be
run. The process cannot access the file
'C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\include\clang\Basic\Release\custombuild.write.1.tlog'
because it is being used by another process.
[C:\public\zorg\buildbot\smooshlab\slave\build.clang-i386-msvc9-rewriter\clang.obj\tools\clang\include\clang\Basic\ClangDiagnosticLex.vcxproj]

    1 Warning(s)
    2 Error(s)
--

Cheers,
 - Daniel
_______________________________________________
cfe-dev mailing list
[hidden email]
http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev
Reply | Threaded
Open this post in threaded view
|

Re: VS10 & Parallel Builds?

Francois Pichet
On Tue, Sep 7, 2010 at 7:44 PM, Daniel Dunbar <[hidden email]> wrote:
> Hi,
>
> Has anyone tried using msbuild and the CMake generated project files
> to do parallel builds?
>

I did it a few times from the IDE (quadcore). Never had the problem
you mention. Then I went back to VS2008 because VS2010 IDE is too
slow.

Are you building from the command line? What command exactly are you
using... i can try it.
_______________________________________________
cfe-dev mailing list
[hidden email]
http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev
Reply | Threaded
Open this post in threaded view
|

Re: VS10 & Parallel Builds?

Vincent R.
>> Hi,
>>
>> Has anyone tried using msbuild and the CMake generated project files
>> to do parallel builds?
>>
>
> I did it a few times from the IDE (quadcore). Never had the problem
> you mention. Then I went back to VS2008 because VS2010 IDE is too
> slow.
>
> Are you building from the command line? What command exactly are you
> using... i can try it.
> _______________________________________________

VS2010 has some issues compared to VS2008, regularly I have problem on
a big project(c++/managed c++/.net) with it because some MSBuild zombie
are created. If sometimes you get some weirds errors, close Visual and
start Process explorer.
Very often you can see that some MSbuild.exe still running.
So I am not surprised you have that kind of issues.
_______________________________________________
cfe-dev mailing list
[hidden email]
http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev
Reply | Threaded
Open this post in threaded view
|

Re: VS10 & Parallel Builds?

Daniel Dunbar
In reply to this post by Francois Pichet
On Tue, Sep 7, 2010 at 5:25 PM, Francois Pichet <[hidden email]> wrote:

> On Tue, Sep 7, 2010 at 7:44 PM, Daniel Dunbar <[hidden email]> wrote:
>> Hi,
>>
>> Has anyone tried using msbuild and the CMake generated project files
>> to do parallel builds?
>>
>
> I did it a few times from the IDE (quadcore). Never had the problem
> you mention. Then I went back to VS2008 because VS2010 IDE is too
> slow.
>
> Are you building from the command line? What command exactly are you
> using... i can try it.

I am just trying "msbuild /m:4 LLVN.sln /p:Configuration=Release
/p:Platform=Win32"
(typed from memory, I don't have the machine in front of me at the moment).

 - Daniel
>
_______________________________________________
cfe-dev mailing list
[hidden email]
http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev